-- Logs begin at Fri 2022-09-09 10:29:27 UTC, end at Fri 2022-09-09 11:32:59 UTC. -- Sep 09 11:04:36.555715 dv-osbrick-856710-1-ceph systemd[1]: Starting Devstack devstack@keystone.service... Sep 09 11:04:36.565821 dv-osbrick-856710-1-ceph devstack@keystone.service[88450]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 09 11:04:36.566472 dv-osbrick-856710-1-ceph devstack@keystone.service[88450]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 11:04:36 2022] *** Sep 09 11:04:36.566472 dv-osbrick-856710-1-ceph devstack@keystone.service[88450]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 11:04:36.566472 dv-osbrick-856710-1-ceph devstack@keystone.service[88450]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 11:04:36.566472 dv-osbrick-856710-1-ceph devstack@keystone.service[88450]: nodename: dv-osbrick-856710-1-ceph Sep 09 11:04:36.566472 dv-osbrick-856710-1-ceph devstack@keystone.service[88450]: machine: x86_64 Sep 09 11:04:36.566472 dv-osbrick-856710-1-ceph devstack@keystone.service[88450]: clock source: unix Sep 09 11:04:36.566472 dv-osbrick-856710-1-ceph devstack@keystone.service[88450]: pcre jit disabled Sep 09 11:04:36.566472 dv-osbrick-856710-1-ceph devstack@keystone.service[88450]: detected number of CPU cores: 4 Sep 09 11:04:36.566472 dv-osbrick-856710-1-ceph devstack@keystone.service[88450]: current working directory: / Sep 09 11:04:36.566472 dv-osbrick-856710-1-ceph devstack@keystone.service[88450]: detected binary path: /usr/bin/uwsgi-core Sep 09 11:04:36.566472 dv-osbrick-856710-1-ceph devstack@keystone.service[88450]: your processes number limit is 47680 Sep 09 11:04:36.566472 dv-osbrick-856710-1-ceph devstack@keystone.service[88450]: your memory page size is 4096 bytes Sep 09 11:04:36.566472 dv-osbrick-856710-1-ceph devstack@keystone.service[88450]: detected max file descriptor number: 2048 Sep 09 11:04:36.566472 dv-osbrick-856710-1-ceph devstack@keystone.service[88450]: lock engine: pthread robust mutexes Sep 09 11:04:36.566472 dv-osbrick-856710-1-ceph devstack@keystone.service[88450]: thunder lock: enabled Sep 09 11:04:36.566472 dv-osbrick-856710-1-ceph devstack@keystone.service[88450]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 09 11:04:36.566472 dv-osbrick-856710-1-ceph devstack@keystone.service[88450]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 11:04:36.610608 dv-osbrick-856710-1-ceph devstack@keystone.service[88450]: Python main interpreter initialized at 0x558cdc44a9c0 Sep 09 11:04:36.610608 dv-osbrick-856710-1-ceph devstack@keystone.service[88450]: python threads support enabled Sep 09 11:04:36.610608 dv-osbrick-856710-1-ceph devstack@keystone.service[88450]: your server socket listen backlog is limited to 100 connections Sep 09 11:04:36.610608 dv-osbrick-856710-1-ceph devstack@keystone.service[88450]: your mercy for graceful operations on workers is 90 seconds Sep 09 11:04:36.610980 dv-osbrick-856710-1-ceph devstack@keystone.service[88450]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 11:04:36.610980 dv-osbrick-856710-1-ceph devstack@keystone.service[88450]: *** Operational MODE: preforking *** Sep 09 11:04:36.611278 dv-osbrick-856710-1-ceph devstack@keystone.service[88450]: *** uWSGI is running in multiple interpreter mode *** Sep 09 11:04:36.611278 dv-osbrick-856710-1-ceph devstack@keystone.service[88450]: spawned uWSGI master process (pid: 88450) Sep 09 11:04:36.611496 dv-osbrick-856710-1-ceph systemd[1]: Started Devstack devstack@keystone.service. Sep 09 11:04:36.617322 dv-osbrick-856710-1-ceph devstack@keystone.service[88450]: spawned uWSGI worker 1 (pid: 88462, cores: 1) Sep 09 11:04:36.617322 dv-osbrick-856710-1-ceph devstack@keystone.service[88450]: spawned uWSGI worker 2 (pid: 88463, cores: 1) Sep 09 11:04:36.617322 dv-osbrick-856710-1-ceph devstack@keystone.service[88450]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 11:04:41.254148 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 11:04:41.254148 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: from cryptography.utils import int_from_bytes Sep 09 11:04:41.254981 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 11:04:41.254981 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: from cryptography.utils import int_from_bytes Sep 09 11:04:41.255097 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 11:04:41.255097 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: from cryptography.utils import int_from_bytes Sep 09 11:04:41.255097 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 11:04:41.255097 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: from cryptography.utils import int_from_bytes Sep 09 11:04:41.305447 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 11:04:41.305648 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 11:04:41.305741 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 11:04:41.305833 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 11:04:41.305914 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] command line args: [] {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 11:04:41.305993 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] command line args: [] {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 11:04:41.306076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 11:04:41.306154 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 11:04:41.306225 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ================================================================================ {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 11:04:41.306335 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ================================================================================ {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 11:04:41.306465 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] admin_token = **** {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.306590 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] admin_token = **** {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.306706 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] config_dir = [] {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.306837 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] config_dir = [] {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.306923 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.307033 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.307160 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] config_source = [] {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.307258 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] config_source = [] {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.307338 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] debug = True {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.307418 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] debug = True {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.307492 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.307678 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.307776 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.307845 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.307904 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.307985 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.309062 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.309170 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.309241 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.309335 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.309413 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] list_limit = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.309475 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] list_limit = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.309532 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] log_config_append = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.309600 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] log_config_append = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.309659 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.309716 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.309773 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] log_dir = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.309834 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] log_dir = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.309898 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] log_file = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.309988 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] log_file = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.310060 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.310126 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.310190 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.310253 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.310312 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.310376 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.310436 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.310436 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.310547 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.310611 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.310679 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.310679 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.310796 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.310963 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.311042 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.311192 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.311282 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.311402 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.311478 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.311745 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.311823 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.311892 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.311960 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.312080 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.312165 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.312308 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.312395 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.312567 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.312689 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.312879 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.313082 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.313251 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] publish_errors = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.313379 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.313567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.313674 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] publish_errors = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.313744 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.313812 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.313877 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.313943 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.314728 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.314829 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.314917 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.314989 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.315195 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] standard_threads = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.315282 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.315366 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.315438 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] standard_threads = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.315604 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.315690 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.315772 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.315841 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.315901 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] use_journal = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.316013 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.316082 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] use_json = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.316141 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] use_journal = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.316198 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] use_stderr = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.316422 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] use_json = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.316509 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] use_syslog = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.316579 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] use_stderr = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.316760 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.316848 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] use_syslog = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.316911 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.316969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:04:41.317031 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.317098 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.317264 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.317479 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.317561 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.317624 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.318184 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.318250 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.318308 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.318370 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.318436 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.318496 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.318553 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.318610 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.318666 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.318751 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.318875 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.318976 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.319122 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.319410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.319576 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.319709 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.319853 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.319986 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.320184 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.320320 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.320451 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.320574 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.320720 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.320851 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.320973 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.321107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.321235 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.321400 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.321607 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.321739 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.321866 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.321994 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.322128 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.322257 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.322392 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.322520 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.322649 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.322776 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.322903 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.323036 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.323173 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.323313 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.323441 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.323568 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.323702 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.323838 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.323973 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.324102 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.324230 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.324357 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.324490 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.324625 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.324760 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.324893 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.325030 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.325158 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.325299 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.325441 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.325578 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.325706 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.325840 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.325968 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.326056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.326233 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.326365 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.326452 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.326526 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.326647 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.326723 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.326812 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.326887 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.326957 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.327027 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.327096 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.327172 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.327319 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.327401 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.327479 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.327551 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.327627 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.327699 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.327777 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.327849 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.327920 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.327989 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.328065 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.328136 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.328213 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.328286 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.328286 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.328411 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.328481 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.328556 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.328556 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.328705 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.328705 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.328844 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.328916 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.328985 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.329062 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.329134 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.329204 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.329273 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.329399 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.329504 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.329708 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.329792 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.329866 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.329937 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.330075 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.330168 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.330408 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.330488 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.330645 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.330728 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.330873 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.330961 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.331129 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.331218 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.331360 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.331448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.331587 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.331668 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.331822 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.331903 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.332056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.332138 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.332293 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.332371 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.332532 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.332620 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.332778 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.332857 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.333019 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.333098 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.333252 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.333417 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.333505 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.333579 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.333729 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.333810 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.333973 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.334061 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.334207 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.334287 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.334439 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.334524 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.334680 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.334780 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.334910 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.334990 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.335152 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.335231 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.335384 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.335471 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.335618 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.335699 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.335852 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.335931 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.336085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.336172 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.336317 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.336398 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.336554 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.336634 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.336791 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.336883 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.337031 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.337111 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.337267 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.337408 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.337522 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.337683 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.337762 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.337839 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.337980 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.338061 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.338217 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.338309 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.338449 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.338544 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.338674 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.338760 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.338899 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.338979 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.339123 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.339214 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.339352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.339430 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.339573 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.339653 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.339807 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.339894 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.340035 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.340114 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.340277 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.340400 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.340509 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.340624 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.340754 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.340991 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.341073 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.341247 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.341384 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.341528 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.341610 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.341790 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.341889 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] auth.external = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.341995 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] auth.external = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.342135 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.342222 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.342457 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.342547 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.342692 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.342782 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.342918 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] auth.password = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.343006 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] auth.password = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.343149 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] auth.token = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.343290 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] auth.token = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.343369 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.343441 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.343608 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.343691 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.343852 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.343935 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.344081 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.344168 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.344326 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.344455 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.344570 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.344654 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.344796 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.344878 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.345028 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] credential.caching = True {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.345161 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] credential.caching = True {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.345318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.345449 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.345533 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.345702 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.345832 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.345915 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.346001 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.346077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.346246 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.346336 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.346477 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.346559 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.346719 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.346801 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.346969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.347048 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.347200 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.347281 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.347448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.347546 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.347973 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.348060 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.348134 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.348207 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.348287 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.348361 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.348439 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.348513 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.348670 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.348752 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.348900 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] federation.caching = True {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.348982 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] federation.caching = True {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.349135 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.349215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.349392 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.349471 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.349630 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.349713 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.349857 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.349937 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.350099 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.350179 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.350335 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.350416 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.350581 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.350660 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.350814 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.350894 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.351065 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.351148 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.351300 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.351381 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.351546 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.351703 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.351780 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] identity.caching = True {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.351851 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] identity.caching = True {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.352012 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.352093 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.352256 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.352343 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.352487 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.352567 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.352717 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.352797 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.352961 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.353049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.353188 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.353296 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.353449 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.353531 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.353696 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.353787 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.353945 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.354025 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.354172 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.354252 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.354397 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.354485 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.354624 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.354705 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.354863 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.354945 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.355105 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.355194 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.355345 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.355433 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.355593 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.355674 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.355835 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.355924 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.356100 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.356181 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.356334 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.356423 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.356567 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.356656 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.356790 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.356871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.357023 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.357103 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.357248 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.357366 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.357501 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.357583 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.357735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.357816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.357971 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.358064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.358216 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.358296 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.358441 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.358540 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.358683 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.358774 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.358922 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.359003 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.359151 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.359230 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.359391 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.359480 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.359630 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.359711 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.359854 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.359934 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.360088 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.360181 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.360314 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.360396 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.360546 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.360626 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.360779 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.361545 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.361545 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.361691 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.361793 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.361875 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.362032 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.362127 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.362279 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.362359 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.362523 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.362605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.362750 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.362840 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.362976 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.363058 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.363219 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.363308 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.363461 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.363552 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.363691 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.363773 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.363922 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.364003 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.364154 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.364237 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.364381 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.user = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.364462 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.user = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.364617 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.364698 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.364870 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.364953 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.365100 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.365180 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.365366 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.365451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.365613 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.365701 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.365853 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.365933 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.366084 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.366163 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.366308 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.366438 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.366538 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.366620 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.366768 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.366847 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.366997 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.367079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.367223 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.367304 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.367463 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.367544 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.367703 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.367786 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.367943 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.368024 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.368185 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.368265 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.368424 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.368505 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.368650 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.368729 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.368888 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.368967 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.369118 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.369201 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.369373 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.369457 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.369606 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.369688 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.369836 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.369919 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.370078 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.370158 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.370317 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.370401 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.370548 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.370631 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.370794 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.370876 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.371019 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.371103 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.371258 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.371350 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.371487 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.371571 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.371718 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.371808 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.371950 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.372032 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.372190 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.372270 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.372427 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.372555 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.372642 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.372718 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.372877 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.372966 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.373115 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] resource.caching = True {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.373204 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] resource.caching = True {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.373381 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.373468 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.373629 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.373710 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.373864 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.373945 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.374108 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.374193 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.374355 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.374437 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.374586 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.374666 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.374819 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.374896 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.375045 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.375127 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.375280 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.375361 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.375510 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] role.caching = True {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.375593 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] role.caching = True {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.375752 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] role.driver = sql {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.375833 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] role.driver = sql {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.375978 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.376060 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.376222 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.376304 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.376482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.376593 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.377260 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.377436 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.377515 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.377588 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.377762 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.377844 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.378008 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.378098 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.378253 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.378334 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.378496 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.378580 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.378726 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.378816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.378970 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.379052 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.379212 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.379292 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.379454 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.379542 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.379694 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.379774 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.380124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.380203 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.380354 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.380442 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.380598 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.380679 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.380842 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.380923 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.381085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.381174 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.381349 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.381436 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.381580 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.381661 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.381830 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.381924 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.382079 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.382160 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.382313 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.382393 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.382539 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.382622 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.382765 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.382847 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.382992 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.383073 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.383240 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.383323 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.383488 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.383569 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.383732 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.383812 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.383962 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.384043 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.384193 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.384272 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.384416 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.384496 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.384646 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] token.caching = True {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.384729 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] token.caching = True {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.384879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.384960 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.385126 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.385205 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.385379 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.385461 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.385633 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.385712 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.385872 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.385951 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.386106 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.386188 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.386344 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.386425 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.386583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.386673 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.386823 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.386905 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.387055 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.387135 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.387288 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.387369 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.387521 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.387601 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.387758 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.387838 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.388033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.388114 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.388260 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.388350 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.388497 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.388589 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.388758 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.388840 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.389015 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] database.connection = **** {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.389095 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] database.connection = **** {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.389254 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.389382 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.389519 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.389601 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.389752 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.389832 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.389988 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.390077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.390219 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.390300 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.390451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.390530 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.390681 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.390769 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.390913 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.390994 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.391151 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.391232 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.391383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.391472 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.391621 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.391702 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.391850 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.391937 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.392112 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.392219 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.392343 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.392426 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.392583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.392664 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.392808 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.392899 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.393042 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.393123 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.393274 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.393427 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:04:41.393501 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 11:04:41.393587 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 11:04:41.423011 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.423233 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.423319 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.423997 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.424227 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.424343 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.433056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.433234 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.462080 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.462286 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.462378 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.462457 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.517178 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.517360 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.568251 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.568445 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.568445 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.568569 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.636217 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.636396 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.636496 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.636577 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.636653 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.636797 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.636882 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.637012 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.637098 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.637225 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.637361 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.637470 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.660920 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.661052 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.661153 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.661362 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.661451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.661527 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.661620 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.661744 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.661829 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.661961 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.662045 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.662174 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.662259 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.662387 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.673725 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.673891 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.686163 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.686340 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.686428 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.686576 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.686661 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.686792 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.686876 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.687003 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.687087 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.687212 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.687297 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.687421 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.687507 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.687632 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:04:41.704924 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.705135 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 11:04:41.705511 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.705703 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.705790 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 11:04:41.705913 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 11:04:41.705998 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.706220 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.706316 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.706436 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 11:04:41.706517 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.706706 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.706788 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.706967 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.707224 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.707477 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.716178 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.716452 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.716722 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.716922 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.717007 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.717199 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.717487 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.717765 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.724458 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.725183 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.728646 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.728933 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.729215 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.729332 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.729532 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.729617 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.729811 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.729895 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.730079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.730171 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.730354 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.730437 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.730608 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.730689 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.730872 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.730956 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.731141 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.731223 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.731407 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.731498 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.731676 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.731937 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.754812 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.754983 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.756273 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.756436 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.756559 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.756720 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.761119 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.761221 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.761423 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.761511 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.763371 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.763457 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.769891 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.769998 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.770132 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.770216 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.774065 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.774152 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.774355 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.774451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.774635 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.774741 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.775020 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.775103 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.775294 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.775379 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.775569 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.775649 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.775838 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.775927 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.776105 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.776187 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.792009 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.792146 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.792280 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.792387 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.796400 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.796501 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.799574 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.799666 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.799979 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.800066 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.804170 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.804267 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.807286 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.807396 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.810361 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.810490 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.810655 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.810788 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.810936 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.811073 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.811341 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.811485 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.811627 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.811774 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.811905 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.812061 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.828055 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.828338 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.828439 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.828602 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.828685 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.828863 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.828946 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.829134 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.835649 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.835938 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.837274 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.837601 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.838816 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.839090 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.839186 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.839401 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.841711 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.841989 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.842079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.842282 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.842367 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.842573 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.842656 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.842849 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.842935 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.843140 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.854117 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.854398 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.854499 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.854676 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.854761 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.854958 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.855042 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.855237 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.855323 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.855516 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.855600 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.855785 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.855869 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.856073 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.871638 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.872064 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.874674 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.875106 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.877669 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.878098 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.879091 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.879525 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.880560 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.880839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.880987 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.881128 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.881267 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.881582 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.887520 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.888013 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.888978 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.889506 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.891867 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.892687 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.892881 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.892971 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.893174 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.893258 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.893495 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.893770 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.901233 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.901545 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.901823 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.902016 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.902307 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.902585 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.909747 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.910036 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.910325 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.910518 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:04:41.910614 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.910805 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.910889 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.911096 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.911180 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.911373 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.911466 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.911645 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.911745 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.911916 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.912044 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.912188 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.912271 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.912461 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.912543 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.912726 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.912811 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.912987 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.913069 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.913242 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.913363 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.913550 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.913814 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.914073 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:04:41.946705 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558cdc44a9c0 pid: 88463 (default app) Sep 09 11:04:41.947736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558cdc44a9c0 pid: 88462 (default app) Sep 09 11:04:41.950167 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504821eb-4300-4bad-a8fd-22cc5abfd71e None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:04:41.950457 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504821eb-4300-4bad-a8fd-22cc5abfd71e None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:04:41.950733 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504821eb-4300-4bad-a8fd-22cc5abfd71e None None] PATH_INFO: `/v3` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:04:41.955342 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Fri Sep 9 11:04:41 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:04:49.219626 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a787f-98bd-4363-82e7-25dcaf317b37 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:04:49.220172 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a787f-98bd-4363-82e7-25dcaf317b37 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:04:49.220260 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a787f-98bd-4363-82e7-25dcaf317b37 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:04:49.224440 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:04:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:04:49.229891 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08406339-5d56-4e70-a8f1-b267733f4664 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:04:49.230428 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08406339-5d56-4e70-a8f1-b267733f4664 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:04:49.230428 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08406339-5d56-4e70-a8f1-b267733f4664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:04:49.305501 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: INFO dbcounter [None req-08406339-5d56-4e70-a8f1-b267733f4664 None None] Registered counter for database keystone Sep 09 11:04:49.326387 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG oslo_db.sqlalchemy.engines [None req-08406339-5d56-4e70-a8f1-b267733f4664 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88463) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 11:04:49.333513 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writer thread running {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 11:04:49.512742 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG passlib.handlers.bcrypt [None req-08406339-5d56-4e70-a8f1-b267733f4664 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88463) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 09 11:04:49.513039 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG passlib.handlers.bcrypt [None req-08406339-5d56-4e70-a8f1-b267733f4664 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88463) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 09 11:04:49.572255 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-08406339-5d56-4e70-a8f1-b267733f4664 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:04:49.573887 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-08406339-5d56-4e70-a8f1-b267733f4664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:04:49.703293 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:04:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 09 11:04:50.237894 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a787f-98bd-4363-82e7-25dcaf317b37 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:04:50.313158 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: INFO dbcounter [None req-227a787f-98bd-4363-82e7-25dcaf317b37 None None] Registered counter for database keystone Sep 09 11:04:50.335394 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG oslo_db.sqlalchemy.engines [None req-227a787f-98bd-4363-82e7-25dcaf317b37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 11:04:50.341665 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writer thread running {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 11:04:50.459637 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a787f-98bd-4363-82e7-25dcaf317b37 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:04:50.464032 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9df3c-b65b-44ec-9f57-cdaa5b7be4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:04:50.464680 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9df3c-b65b-44ec-9f57-cdaa5b7be4cf admin admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:04:50.464963 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9df3c-b65b-44ec-9f57-cdaa5b7be4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:04:50.465233 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9df3c-b65b-44ec-9f57-cdaa5b7be4cf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:04:50.475006 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f9df3c-b65b-44ec-9f57-cdaa5b7be4cf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:04:50.526661 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c2f9df3c-b65b-44ec-9f57-cdaa5b7be4cf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 09 11:04:50.527012 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f9df3c-b65b-44ec-9f57-cdaa5b7be4cf admin admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:04:50.537220 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Fri Sep 9 11:04:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 11:04:50.543141 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08406339-5d56-4e70-a8f1-b267733f4664 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:04:50.559874 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08406339-5d56-4e70-a8f1-b267733f4664 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:04:50.564801 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec9a38-2cb0-4168-801a-0a3372a3f855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:04:50.565946 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec9a38-2cb0-4168-801a-0a3372a3f855 admin admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:04:50.566230 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec9a38-2cb0-4168-801a-0a3372a3f855 admin admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:04:50.566504 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec9a38-2cb0-4168-801a-0a3372a3f855 admin admin] PATH_INFO: `/v3/projects/8b0f23b110ec4b0cbf3d045893105ca2` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:04:50.570280 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec9a38-2cb0-4168-801a-0a3372a3f855 admin admin] RBAC: Authorizing `identity:get_project(project_id=8b0f23b110ec4b0cbf3d045893105ca2)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:04:50.619941 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e7ec9a38-2cb0-4168-801a-0a3372a3f855 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 09 11:04:50.620295 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec9a38-2cb0-4168-801a-0a3372a3f855 admin admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:04:50.624783 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Fri Sep 9 11:04:50 2022] GET /identity/v3/projects/8b0f23b110ec4b0cbf3d045893105ca2 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:04:52.996864 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc632d5-5d4a-4578-8a7d-dae3a15d8810 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:04:52.997475 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc632d5-5d4a-4578-8a7d-dae3a15d8810 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:04:52.997475 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc632d5-5d4a-4578-8a7d-dae3a15d8810 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:04:53.001998 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:04:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:04:53.007729 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42a26d-7d2b-489e-8cfa-5a712702f77a None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:04:53.008151 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42a26d-7d2b-489e-8cfa-5a712702f77a None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:04:53.008328 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42a26d-7d2b-489e-8cfa-5a712702f77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:04:53.029088 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-3f42a26d-7d2b-489e-8cfa-5a712702f77a None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:04:53.030652 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-3f42a26d-7d2b-489e-8cfa-5a712702f77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:04:53.038880 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:04:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 09 11:04:53.354760 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc632d5-5d4a-4578-8a7d-dae3a15d8810 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:04:53.367300 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc632d5-5d4a-4578-8a7d-dae3a15d8810 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:04:53.371440 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f99646-55ff-4e7c-a7f8-83e1527bec8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:04:53.372027 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f99646-55ff-4e7c-a7f8-83e1527bec8f admin admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:04:53.372306 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f99646-55ff-4e7c-a7f8-83e1527bec8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:04:53.372578 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f99646-55ff-4e7c-a7f8-83e1527bec8f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:04:53.380696 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f99646-55ff-4e7c-a7f8-83e1527bec8f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:04:53.382481 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f99646-55ff-4e7c-a7f8-83e1527bec8f admin admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:04:53.391008 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Fri Sep 9 11:04:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 11:04:53.396372 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42a26d-7d2b-489e-8cfa-5a712702f77a None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:04:53.405510 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42a26d-7d2b-489e-8cfa-5a712702f77a None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:04:53.409844 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32845ab4-ee9b-4077-b252-e646e4e20fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:04:53.410521 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32845ab4-ee9b-4077-b252-e646e4e20fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:04:53.410801 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32845ab4-ee9b-4077-b252-e646e4e20fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:04:53.411075 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32845ab4-ee9b-4077-b252-e646e4e20fe7 admin admin] PATH_INFO: `/v3/users/07397da3682f4089a3c3c8d08484a85f` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:04:53.412371 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32845ab4-ee9b-4077-b252-e646e4e20fe7 admin admin] RBAC: Authorizing `identity:get_user(user_id=07397da3682f4089a3c3c8d08484a85f)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:04:53.414233 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32845ab4-ee9b-4077-b252-e646e4e20fe7 admin admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:04:53.415733 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Fri Sep 9 11:04:53 2022] GET /identity/v3/users/07397da3682f4089a3c3c8d08484a85f => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:04:55.865102 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4a5d9-7351-47de-9d59-a9d371a877af None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:04:55.865679 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4a5d9-7351-47de-9d59-a9d371a877af None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:04:55.865679 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4a5d9-7351-47de-9d59-a9d371a877af None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:04:55.867048 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:04:55.872286 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3afbe-cfb5-448f-b3a8-590c40c62661 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:04:55.872734 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3afbe-cfb5-448f-b3a8-590c40c62661 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:04:55.872828 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3afbe-cfb5-448f-b3a8-590c40c62661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:04:55.893022 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-64c3afbe-cfb5-448f-b3a8-590c40c62661 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:04:55.894241 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-64c3afbe-cfb5-448f-b3a8-590c40c62661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:04:55.971672 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29043f0b-785b-4de4-a543-7a43d4bac711 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:04:55.972074 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29043f0b-785b-4de4-a543-7a43d4bac711 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:04:55.972360 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29043f0b-785b-4de4-a543-7a43d4bac711 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:04:55.973785 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:04:55.978986 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:04:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:04:55.979245 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218d173-62cc-4730-b328-fa5c2ab2874c None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:04:55.979532 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218d173-62cc-4730-b328-fa5c2ab2874c None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:04:55.979816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218d173-62cc-4730-b328-fa5c2ab2874c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:04:56.024519 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG passlib.handlers.bcrypt [None req-b218d173-62cc-4730-b328-fa5c2ab2874c None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88462) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 09 11:04:56.024921 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG passlib.handlers.bcrypt [None req-b218d173-62cc-4730-b328-fa5c2ab2874c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88462) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 09 11:04:56.074672 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-b218d173-62cc-4730-b328-fa5c2ab2874c None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:04:56.076281 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-b218d173-62cc-4730-b328-fa5c2ab2874c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:04:56.181308 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:04:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:04:56.301176 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3afbe-cfb5-448f-b3a8-590c40c62661 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:04:56.325883 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:04:56.508129 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218d173-62cc-4730-b328-fa5c2ab2874c None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:04:56.522340 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3afbe-cfb5-448f-b3a8-590c40c62661 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:04:56.557956 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a6408-3ddc-4590-9a88-43049436f97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:04:56.558606 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a6408-3ddc-4590-9a88-43049436f97f None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:04:56.558892 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a6408-3ddc-4590-9a88-43049436f97f None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:04:56.559171 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a6408-3ddc-4590-9a88-43049436f97f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:04:56.571106 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a6408-3ddc-4590-9a88-43049436f97f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:04:56.579991 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-591a6408-3ddc-4590-9a88-43049436f97f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:04:56.579991 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:04:56.579991 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:04:56.579991 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:04:56.579991 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:04:56.579991 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:04:56.579991 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:04:56.579991 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:04:56.579991 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:04:56.579991 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:04:56.579991 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:04:56.579991 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:04:56.579991 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:04:56.579991 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:04:56.579991 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:04:56.579991 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:04:56.580956 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:04:56.580956 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:04:56.580956 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:04:56.580956 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:04:56.580956 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:04:56.580956 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:04:56.580956 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:04:56.580956 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:04:56.580956 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:04:56.580956 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:04:56.580956 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:04:56.580956 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:04:56.580956 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:04:56.580956 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:04:56.580956 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:04:56.580956 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:04:56.581821 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:04:56.581821 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:04:56.581821 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:04:56.581821 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:04:56.581821 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:04:56.581821 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:04:56.581821 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:04:56.581821 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:04:56.581821 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:04:56.581821 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:04:56.581821 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:04:56.581821 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:04:56.581821 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 9 11:04:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:04:56.587115 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a6408-3ddc-4590-9a88-43049436f97f None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:04:56.613877 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218d173-62cc-4730-b328-fa5c2ab2874c None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:04:56.616226 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:04:56.652996 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc97f1-729b-4113-8b2c-a7389e04a939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:04:56.653995 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc97f1-729b-4113-8b2c-a7389e04a939 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:04:56.654366 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc97f1-729b-4113-8b2c-a7389e04a939 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:04:56.654646 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc97f1-729b-4113-8b2c-a7389e04a939 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:04:56.672680 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:04:56.691959 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a6408-3ddc-4590-9a88-43049436f97f None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:04:56.726068 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52747b0-271e-43f9-a886-7a4d48585666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:04:56.726280 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc97f1-729b-4113-8b2c-a7389e04a939 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:04:56.726681 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52747b0-271e-43f9-a886-7a4d48585666 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:04:56.726960 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52747b0-271e-43f9-a886-7a4d48585666 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:04:56.727230 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52747b0-271e-43f9-a886-7a4d48585666 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:04:56.727595 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc97f1-729b-4113-8b2c-a7389e04a939 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:04:56.727900 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52747b0-271e-43f9-a886-7a4d48585666 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:04:56.728198 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52747b0-271e-43f9-a886-7a4d48585666 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:04:56.729605 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52747b0-271e-43f9-a886-7a4d48585666 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:04:56.742337 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 8/15] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:04:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:04:56.748028 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52747b0-271e-43f9-a886-7a4d48585666 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:04:56.829799 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:04:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 11:04:56.835439 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc97f1-729b-4113-8b2c-a7389e04a939 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:04:56.838226 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:04:56.850582 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52747b0-271e-43f9-a886-7a4d48585666 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:04:56.885206 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5539fc-3f60-42fa-b33f-8f6b6137524d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:04:56.885885 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5539fc-3f60-42fa-b33f-8f6b6137524d None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:04:56.886158 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5539fc-3f60-42fa-b33f-8f6b6137524d None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:04:56.886432 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5539fc-3f60-42fa-b33f-8f6b6137524d None admin] PATH_INFO: `/v3/users/07397da3682f4089a3c3c8d08484a85f` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:04:56.887601 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5539fc-3f60-42fa-b33f-8f6b6137524d None admin] RBAC: Authorizing `identity:get_user(user_id=07397da3682f4089a3c3c8d08484a85f)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:04:56.889073 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5539fc-3f60-42fa-b33f-8f6b6137524d None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:04:56.890874 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:04:56 2022] GET /identity/v3/users/07397da3682f4089a3c3c8d08484a85f => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:04:56.896132 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5539fc-3f60-42fa-b33f-8f6b6137524d None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:04:56.910561 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:04:56.934775 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc97f1-729b-4113-8b2c-a7389e04a939 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:04:56.969088 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43786c8-b511-4d58-a45a-eca36f533061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:04:56.970027 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43786c8-b511-4d58-a45a-eca36f533061 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:04:56.970319 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43786c8-b511-4d58-a45a-eca36f533061 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:04:56.970594 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43786c8-b511-4d58-a45a-eca36f533061 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:04:56.989379 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43786c8-b511-4d58-a45a-eca36f533061 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:04:56.990790 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43786c8-b511-4d58-a45a-eca36f533061 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:04:56.997697 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5539fc-3f60-42fa-b33f-8f6b6137524d None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:04:57.011388 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-c43786c8-b511-4d58-a45a-eca36f533061 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:04:57.011388 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:04:57.011388 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:04:57.011388 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:04:57.011388 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:04:57.011388 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:04:57.011388 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:04:57.011388 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:04:57.011388 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:04:57.011388 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:04:57.011388 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:04:57.011388 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:04:57.011388 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:04:57.011388 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:04:57.011388 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:04:57.011388 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:04:57.012354 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:04:57.012354 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:04:57.012354 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:04:57.012354 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:04:57.012354 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:04:57.012354 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:04:57.012354 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:04:57.012354 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:04:57.012354 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:04:57.012354 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:04:57.012354 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:04:57.012354 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:04:57.012354 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:04:57.012354 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:04:57.012354 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:04:57.012354 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:04:57.012354 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:04:57.013381 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:04:57.013381 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:04:57.013381 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:04:57.013381 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 9/18] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:04:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:04:57.018852 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43786c8-b511-4d58-a45a-eca36f533061 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:04:57.035323 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444940c-6f46-4e88-a52a-2a10bd1e8f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:04:57.035986 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444940c-6f46-4e88-a52a-2a10bd1e8f30 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:04:57.036266 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444940c-6f46-4e88-a52a-2a10bd1e8f30 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:04:57.036537 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444940c-6f46-4e88-a52a-2a10bd1e8f30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:04:57.037779 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b444940c-6f46-4e88-a52a-2a10bd1e8f30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:04:57.039275 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b444940c-6f46-4e88-a52a-2a10bd1e8f30 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:04:57.040927 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 10/19] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:04:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:04:57.047324 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444940c-6f46-4e88-a52a-2a10bd1e8f30 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:04:57.137187 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:04:57.162360 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444940c-6f46-4e88-a52a-2a10bd1e8f30 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:04:57.192115 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:04:57.197407 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63649ad9-9533-4803-86ba-b23203b1cf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:04:57.198038 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63649ad9-9533-4803-86ba-b23203b1cf22 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:04:57.198322 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63649ad9-9533-4803-86ba-b23203b1cf22 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:04:57.198600 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63649ad9-9533-4803-86ba-b23203b1cf22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:04:57.199356 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63649ad9-9533-4803-86ba-b23203b1cf22 None admin] RBAC: Adding query filter params (role.id=b02ba8c157bf46f4a75cdab917db78db, scope.domain.id=default, user.id=07397da3682f4089a3c3c8d08484a85f) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:04:57.199666 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63649ad9-9533-4803-86ba-b23203b1cf22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:04:57.201117 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63649ad9-9533-4803-86ba-b23203b1cf22 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:04:57.208611 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 11/20] 10.222.0.20 () {56 vars in 1322 bytes} [Fri Sep 9 11:04:57 2022] GET /identity/v3/role_assignments?user.id=07397da3682f4089a3c3c8d08484a85f&scope.domain.id=default&role.id=b02ba8c157bf46f4a75cdab917db78db => generated 233 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:04:57.239927 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43786c8-b511-4d58-a45a-eca36f533061 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:04:57.277141 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfee2d-ff5a-4a55-bd72-518fa4839320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:04:57.277808 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfee2d-ff5a-4a55-bd72-518fa4839320 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:04:57.278087 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfee2d-ff5a-4a55-bd72-518fa4839320 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:04:57.278368 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfee2d-ff5a-4a55-bd72-518fa4839320 None admin] PATH_INFO: `/v3/domains` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:04:57.279021 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfee2d-ff5a-4a55-bd72-518fa4839320 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:04:57.279323 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfee2d-ff5a-4a55-bd72-518fa4839320 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:04:57.280760 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfee2d-ff5a-4a55-bd72-518fa4839320 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:04:57.301053 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 10/21] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:04:59.964068 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbf98d-948b-44d3-a592-8f2fcb8c8540 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:04:59.965120 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbf98d-948b-44d3-a592-8f2fcb8c8540 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:04:59.965622 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbf98d-948b-44d3-a592-8f2fcb8c8540 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:04:59.967171 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 12/22] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:04:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:04:59.982999 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c550c49-095f-4517-8fe8-b8d09cdbe730 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:04:59.983483 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c550c49-095f-4517-8fe8-b8d09cdbe730 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:04:59.983556 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c550c49-095f-4517-8fe8-b8d09cdbe730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:00.006376 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-0c550c49-095f-4517-8fe8-b8d09cdbe730 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:00.007618 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-0c550c49-095f-4517-8fe8-b8d09cdbe730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:00.045026 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f538b90-6088-47c5-9092-3602ef03d9c4 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:00.045737 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f538b90-6088-47c5-9092-3602ef03d9c4 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:00.046245 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f538b90-6088-47c5-9092-3602ef03d9c4 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:00.047929 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 13/23] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:00.058919 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10e6ff-9cb0-49c9-b288-ef53da728d16 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:00.059512 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10e6ff-9cb0-49c9-b288-ef53da728d16 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:00.059982 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10e6ff-9cb0-49c9-b288-ef53da728d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:00.101261 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-2b10e6ff-9cb0-49c9-b288-ef53da728d16 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:00.102848 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-2b10e6ff-9cb0-49c9-b288-ef53da728d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:00.106878 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 11/24] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:04:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:00.202836 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 14/25] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:05:00.696339 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c550c49-095f-4517-8fe8-b8d09cdbe730 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:00.761273 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:00.815254 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10e6ff-9cb0-49c9-b288-ef53da728d16 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:00.824811 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c550c49-095f-4517-8fe8-b8d09cdbe730 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:00.886197 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d1ee5d-be91-4704-8600-f99b8d33d30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:00.886692 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1ee5d-be91-4704-8600-f99b8d33d30c None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:00.886977 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1ee5d-be91-4704-8600-f99b8d33d30c None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:00.887254 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1ee5d-be91-4704-8600-f99b8d33d30c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:00.900969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d1ee5d-be91-4704-8600-f99b8d33d30c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:00.900969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d1ee5d-be91-4704-8600-f99b8d33d30c None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:00.920386 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-78d1ee5d-be91-4704-8600-f99b8d33d30c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:05:00.920386 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:00.920386 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:00.920386 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:00.920386 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:00.920386 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:00.920386 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:00.920386 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:00.920386 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:00.920386 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:00.920386 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:00.920386 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:00.920386 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:05:00.920386 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:05:00.920386 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:05:00.920386 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:05:00.921334 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:00.921334 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:00.921334 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:00.921334 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:00.921334 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:00.921334 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:00.921334 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:00.921334 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:00.921334 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:00.921334 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:00.921334 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:00.921334 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:00.921334 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:00.921334 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:00.921334 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:00.921334 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:00.921334 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:05:00.922168 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:05:00.922168 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:05:00.922168 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:05:00.922168 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 12/26] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:05:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:05:00.922986 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1778e-bebc-4f7b-a6d3-7a05e5f8ad78 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:00.923084 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1778e-bebc-4f7b-a6d3-7a05e5f8ad78 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:00.924631 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1778e-bebc-4f7b-a6d3-7a05e5f8ad78 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:00.924631 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:00.930942 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc4833-e6f5-4391-916d-0a9070765293 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:00.931224 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc4833-e6f5-4391-916d-0a9070765293 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:00.931503 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc4833-e6f5-4391-916d-0a9070765293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:00.950781 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-29dc4833-e6f5-4391-916d-0a9070765293 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:00.951919 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-29dc4833-e6f5-4391-916d-0a9070765293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:00.966918 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:01.023226 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 14/28] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:01.024768 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc4833-e6f5-4391-916d-0a9070765293 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:01.041390 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10e6ff-9cb0-49c9-b288-ef53da728d16 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:01.055616 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:01.138142 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3e9bc-4159-414f-a5e2-126c8031c410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:01.138813 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3e9bc-4159-414f-a5e2-126c8031c410 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:01.139152 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3e9bc-4159-414f-a5e2-126c8031c410 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:01.139456 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3e9bc-4159-414f-a5e2-126c8031c410 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:01.166004 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa3e9bc-4159-414f-a5e2-126c8031c410 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:01.171318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-2aa3e9bc-4159-414f-a5e2-126c8031c410 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:05:01.171318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:01.171318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:01.171318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:01.171318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:01.171318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:01.171318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:01.171318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:01.171318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:01.171318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:01.171318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:01.171318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:01.171318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:01.171318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:01.171318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:01.171318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:01.172196 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:01.172196 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:01.172196 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:01.172196 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:01.172196 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:01.172196 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:01.172196 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:01.172196 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:01.172196 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:01.172196 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:01.172196 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:01.172196 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:01.172196 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:01.172196 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:01.172196 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:01.172196 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:01.173582 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:01.173582 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:01.173582 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:01.173582 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:01.173582 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:01.173582 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:01.173582 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:01.173582 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:01.173582 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:01.173582 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:01.173582 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:05:01.173582 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:05:01.177928 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 15/29] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 9 11:05:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:05:01.180423 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3e9bc-4159-414f-a5e2-126c8031c410 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:01.197845 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc4833-e6f5-4391-916d-0a9070765293 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:01.270666 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713566d8-ab8d-4ca8-9733-599cef265e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:01.271299 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713566d8-ab8d-4ca8-9733-599cef265e14 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:01.271577 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713566d8-ab8d-4ca8-9733-599cef265e14 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:01.271844 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713566d8-ab8d-4ca8-9733-599cef265e14 None admin] PATH_INFO: `/v3/domains` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:01.272685 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713566d8-ab8d-4ca8-9733-599cef265e14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:01.273913 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713566d8-ab8d-4ca8-9733-599cef265e14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:01.275621 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713566d8-ab8d-4ca8-9733-599cef265e14 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:01.304824 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 15/30] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:01.306736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318ddef-6204-4f56-8f02-b7617d734677 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:01.307188 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318ddef-6204-4f56-8f02-b7617d734677 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:01.307618 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318ddef-6204-4f56-8f02-b7617d734677 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:01.309009 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 16/31] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:01.311029 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318ddef-6204-4f56-8f02-b7617d734677 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:01.374160 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3e9bc-4159-414f-a5e2-126c8031c410 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:01.419717 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddef44a-7b0c-4acd-b8da-e82a819e71d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:01.421464 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddef44a-7b0c-4acd-b8da-e82a819e71d9 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:01.422240 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddef44a-7b0c-4acd-b8da-e82a819e71d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:01.423498 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddef44a-7b0c-4acd-b8da-e82a819e71d9 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:01.424556 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddef44a-7b0c-4acd-b8da-e82a819e71d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:01.425068 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddef44a-7b0c-4acd-b8da-e82a819e71d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:01.426774 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddef44a-7b0c-4acd-b8da-e82a819e71d9 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:01.430598 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:01.443825 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 16/32] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:05:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:01.450907 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fc527-3198-4bd3-8d5a-743f054dbcba None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:01.451385 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fc527-3198-4bd3-8d5a-743f054dbcba None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:01.452131 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fc527-3198-4bd3-8d5a-743f054dbcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:01.484217 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-b72fc527-3198-4bd3-8d5a-743f054dbcba None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:01.486006 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-b72fc527-3198-4bd3-8d5a-743f054dbcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:01.520830 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:01.538363 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318ddef-6204-4f56-8f02-b7617d734677 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:01.576155 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 17/33] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:01.577529 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72fc527-3198-4bd3-8d5a-743f054dbcba None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:01.577648 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48979f7b-5dbd-4f10-a219-a5e581e7ea6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:01.578266 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48979f7b-5dbd-4f10-a219-a5e581e7ea6c None admin] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:01.578520 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48979f7b-5dbd-4f10-a219-a5e581e7ea6c None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:01.578825 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48979f7b-5dbd-4f10-a219-a5e581e7ea6c None admin] PATH_INFO: `/v3/projects` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:01.579703 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48979f7b-5dbd-4f10-a219-a5e581e7ea6c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:01.581158 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48979f7b-5dbd-4f10-a219-a5e581e7ea6c None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:01.758198 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 17/34] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 9 11:05:01 2022] POST /identity/v3/projects => generated 301 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:05:01.759345 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48979f7b-5dbd-4f10-a219-a5e581e7ea6c None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:01.785735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72fc527-3198-4bd3-8d5a-743f054dbcba None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:01.849599 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:01.871616 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c08cbc-469c-45cf-bfa8-f53c1a45be6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:01.872387 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c08cbc-469c-45cf-bfa8-f53c1a45be6f None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:01.872735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c08cbc-469c-45cf-bfa8-f53c1a45be6f None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:01.873099 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c08cbc-469c-45cf-bfa8-f53c1a45be6f None admin] PATH_INFO: `/v3/users/07397da3682f4089a3c3c8d08484a85f` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:01.878066 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c08cbc-469c-45cf-bfa8-f53c1a45be6f None admin] RBAC: Authorizing `identity:get_user(user_id=07397da3682f4089a3c3c8d08484a85f)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:01.880036 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c08cbc-469c-45cf-bfa8-f53c1a45be6f None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:01.881936 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 18/35] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:01 2022] GET /identity/v3/users/07397da3682f4089a3c3c8d08484a85f => generated 247 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:01.887794 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c08cbc-469c-45cf-bfa8-f53c1a45be6f None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:01.897229 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48979f7b-5dbd-4f10-a219-a5e581e7ea6c None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:01.945604 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabdf07-81ff-4926-b412-0cd39d9a0f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:01.946554 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabdf07-81ff-4926-b412-0cd39d9a0f64 None admin] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:01.947021 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabdf07-81ff-4926-b412-0cd39d9a0f64 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:01.947476 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabdf07-81ff-4926-b412-0cd39d9a0f64 None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:01.949001 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabdf07-81ff-4926-b412-0cd39d9a0f64 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:01.951401 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabdf07-81ff-4926-b412-0cd39d9a0f64 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:01.977250 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:01.987226 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 18/36] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Sep 9 11:05:01 2022] POST /identity/v3/roles => generated 225 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:05:01.993945 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa4d90-95f6-45f6-aeae-c8195280ace0 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:01.997314 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa4d90-95f6-45f6-aeae-c8195280ace0 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:01.997314 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa4d90-95f6-45f6-aeae-c8195280ace0 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:01.998357 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 19/37] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:01 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:02.001899 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b6b2f-bc28-4341-8fc2-18955129563e None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:02.002208 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b6b2f-bc28-4341-8fc2-18955129563e None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:02.002717 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b6b2f-bc28-4341-8fc2-18955129563e None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:02.012508 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 20/38] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:02.018373 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f397b-03ad-4222-96c6-d6dfadf2d650 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:02.020468 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f397b-03ad-4222-96c6-d6dfadf2d650 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:02.020468 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f397b-03ad-4222-96c6-d6dfadf2d650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:02.062950 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-ce8f397b-03ad-4222-96c6-d6dfadf2d650 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:02.066945 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-ce8f397b-03ad-4222-96c6-d6dfadf2d650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:02.098590 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c08cbc-469c-45cf-bfa8-f53c1a45be6f None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:02.155848 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a7c52-5fa5-4b16-993e-b956d34a8383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:02.156519 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a7c52-5fa5-4b16-993e-b956d34a8383 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:02.157630 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a7c52-5fa5-4b16-993e-b956d34a8383 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:02.157630 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a7c52-5fa5-4b16-993e-b956d34a8383 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:02.159274 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a7c52-5fa5-4b16-993e-b956d34a8383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:02.160485 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a7c52-5fa5-4b16-993e-b956d34a8383 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:02.162349 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 19/39] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:05:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:05:02.164180 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12225cc3-9e31-493c-b9cb-ca689fa49cda None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:02.164180 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12225cc3-9e31-493c-b9cb-ca689fa49cda None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:02.164180 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12225cc3-9e31-493c-b9cb-ca689fa49cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:02.187007 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-12225cc3-9e31-493c-b9cb-ca689fa49cda None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:02.188808 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-12225cc3-9e31-493c-b9cb-ca689fa49cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:02.196766 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 21/40] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:02.197686 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f397b-03ad-4222-96c6-d6dfadf2d650 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:02.279112 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:02.294661 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 20/41] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:02.295758 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12225cc3-9e31-493c-b9cb-ca689fa49cda None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:02.355863 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f397b-03ad-4222-96c6-d6dfadf2d650 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:02.391179 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:02.399253 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3206c9-288f-4ab7-b7e5-f15357b9dee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:02.399700 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3206c9-288f-4ab7-b7e5-f15357b9dee8 None admin] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:02.399998 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3206c9-288f-4ab7-b7e5-f15357b9dee8 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:02.400260 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3206c9-288f-4ab7-b7e5-f15357b9dee8 None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:02.400947 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3206c9-288f-4ab7-b7e5-f15357b9dee8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:02.402425 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3206c9-288f-4ab7-b7e5-f15357b9dee8 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:02.433219 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Sep 9 11:05:02 2022] POST /identity/v3/roles => generated 219 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:05:02.455273 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12225cc3-9e31-493c-b9cb-ca689fa49cda None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:02.505954 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40ec98-61d6-407e-a2b9-9aa6cd800d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:02.507093 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40ec98-61d6-407e-a2b9-9aa6cd800d44 None admin] REQUEST_METHOD: `PUT` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:02.507585 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40ec98-61d6-407e-a2b9-9aa6cd800d44 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:02.508078 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40ec98-61d6-407e-a2b9-9aa6cd800d44 None admin] PATH_INFO: `/v3/domains/default/users/07397da3682f4089a3c3c8d08484a85f/roles/b02ba8c157bf46f4a75cdab917db78db` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:02.510639 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40ec98-61d6-407e-a2b9-9aa6cd800d44 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=07397da3682f4089a3c3c8d08484a85f, role_id=b02ba8c157bf46f4a75cdab917db78db)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:02.512672 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40ec98-61d6-407e-a2b9-9aa6cd800d44 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:02.540371 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3206c9-288f-4ab7-b7e5-f15357b9dee8 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:02.670356 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 21/43] 10.222.0.20 () {58 vars in 1361 bytes} [Fri Sep 9 11:05:02 2022] PUT /identity/v3/domains/default/users/07397da3682f4089a3c3c8d08484a85f/roles/b02ba8c157bf46f4a75cdab917db78db => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:05:02.679140 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40ec98-61d6-407e-a2b9-9aa6cd800d44 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:02.692328 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3206c9-288f-4ab7-b7e5-f15357b9dee8 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:02.740328 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ba537-db3e-4b88-b764-12b2a68c8832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:02.740979 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ba537-db3e-4b88-b764-12b2a68c8832 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:02.741261 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ba537-db3e-4b88-b764-12b2a68c8832 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:02.741567 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ba537-db3e-4b88-b764-12b2a68c8832 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:02.742824 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ba537-db3e-4b88-b764-12b2a68c8832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:02.744967 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ba537-db3e-4b88-b764-12b2a68c8832 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:02.746618 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 23/44] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:05:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:05:02.749821 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:02.753145 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ba537-db3e-4b88-b764-12b2a68c8832 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:02.822622 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40ec98-61d6-407e-a2b9-9aa6cd800d44 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:02.841383 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:02.872201 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840373f-139b-4f3e-91e7-8486a6300fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:02.873535 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840373f-139b-4f3e-91e7-8486a6300fa7 None admin] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:02.873825 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840373f-139b-4f3e-91e7-8486a6300fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:02.874461 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840373f-139b-4f3e-91e7-8486a6300fa7 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:02.875182 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840373f-139b-4f3e-91e7-8486a6300fa7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:02.876900 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840373f-139b-4f3e-91e7-8486a6300fa7 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:02.898821 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Sep 9 11:05:02 2022] POST /identity/v3/roles => generated 223 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:05:02.899364 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ba537-db3e-4b88-b764-12b2a68c8832 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:02.943633 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32363975-a1d7-45fa-b0d6-e9cab1bb32eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:02.944186 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32363975-a1d7-45fa-b0d6-e9cab1bb32eb None admin] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:02.944472 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32363975-a1d7-45fa-b0d6-e9cab1bb32eb None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:02.944752 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32363975-a1d7-45fa-b0d6-e9cab1bb32eb None admin] PATH_INFO: `/v3/projects` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:02.945465 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32363975-a1d7-45fa-b0d6-e9cab1bb32eb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:02.946973 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32363975-a1d7-45fa-b0d6-e9cab1bb32eb None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:02.979902 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 9 11:05:02 2022] POST /identity/v3/projects => generated 312 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:05:05.144683 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edfb6a-ae05-4528-99b4-6cb40ec6f102 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:05.145258 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edfb6a-ae05-4528-99b4-6cb40ec6f102 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:05.145258 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edfb6a-ae05-4528-99b4-6cb40ec6f102 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:05.146597 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 23/47] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:05.151871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb7ea2-1749-482b-9205-580fb06be80a None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:05.152268 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb7ea2-1749-482b-9205-580fb06be80a None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:05.152431 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb7ea2-1749-482b-9205-580fb06be80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:05.171453 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-39bb7ea2-1749-482b-9205-580fb06be80a None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:05.173153 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-39bb7ea2-1749-482b-9205-580fb06be80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:05.238808 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 25/48] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:05.400383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad237614-0598-4464-a875-ee11ca4695b9 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:05.400591 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad237614-0598-4464-a875-ee11ca4695b9 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:05.400903 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad237614-0598-4464-a875-ee11ca4695b9 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:05.402393 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 24/49] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:05.408016 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3681c96-4dde-4f3c-84f9-dcd341a187c8 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:05.408303 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3681c96-4dde-4f3c-84f9-dcd341a187c8 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:05.408582 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3681c96-4dde-4f3c-84f9-dcd341a187c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:05.428894 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-c3681c96-4dde-4f3c-84f9-dcd341a187c8 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:05.430121 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-c3681c96-4dde-4f3c-84f9-dcd341a187c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:05.464840 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:05.499405 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 26/50] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:05.560834 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad237614-0598-4464-a875-ee11ca4695b9 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:05.663170 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad237614-0598-4464-a875-ee11ca4695b9 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:05.676126 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:05.697963 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ecd70-472b-4fd2-815f-d725635f4d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:05.698595 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ecd70-472b-4fd2-815f-d725635f4d9f None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:05.698881 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ecd70-472b-4fd2-815f-d725635f4d9f None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:05.699155 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ecd70-472b-4fd2-815f-d725635f4d9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:05.710009 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ecd70-472b-4fd2-815f-d725635f4d9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:05.714839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-e23ecd70-472b-4fd2-815f-d725635f4d9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:05:05.714839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:05.714839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:05.714839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:05.714839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:05.714839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:05.714839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:05.714839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:05.714839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:05.714839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:05.714839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:05.714839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:05.714839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:05.714839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:05.714839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:05.714839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:05.715661 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:05.715661 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:05.715661 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:05.715661 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:05.715661 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:05.715661 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:05.715661 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:05.715661 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:05.715661 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:05.715661 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:05.715661 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:05.715661 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:05.715661 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:05.715661 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:05.715661 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:05.715661 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:05.716416 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:05.716416 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:05.716416 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:05.716416 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:05.716416 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:05.716416 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:05.716416 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:05.716416 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:05.716416 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:05.716416 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:05.716416 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:05:05.716416 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:05:05.716416 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 25/51] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 9 11:05:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:05:05.721784 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3681c96-4dde-4f3c-84f9-dcd341a187c8 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:05.818379 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ecd70-472b-4fd2-815f-d725635f4d9f None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:05.820439 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3681c96-4dde-4f3c-84f9-dcd341a187c8 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:05.854467 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430fa45-8c32-472f-a569-791bcc7a8c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:05.855076 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430fa45-8c32-472f-a569-791bcc7a8c11 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:05.855361 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430fa45-8c32-472f-a569-791bcc7a8c11 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:05.855637 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430fa45-8c32-472f-a569-791bcc7a8c11 None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:05.856296 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430fa45-8c32-472f-a569-791bcc7a8c11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:05.856598 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430fa45-8c32-472f-a569-791bcc7a8c11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:05.858004 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430fa45-8c32-472f-a569-791bcc7a8c11 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:05.870216 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 27/52] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:05:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:05.876481 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430fa45-8c32-472f-a569-791bcc7a8c11 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:05.911421 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:05.917665 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ecd70-472b-4fd2-815f-d725635f4d9f None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:05.953697 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e0eaa-335b-49a3-99ee-c101ab4cea0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:05.954323 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e0eaa-335b-49a3-99ee-c101ab4cea0d None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:05.954601 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e0eaa-335b-49a3-99ee-c101ab4cea0d None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:05.954872 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e0eaa-335b-49a3-99ee-c101ab4cea0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:05.956075 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e0eaa-335b-49a3-99ee-c101ab4cea0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:05.957548 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e0eaa-335b-49a3-99ee-c101ab4cea0d None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:05.959102 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:05:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:05:05.964545 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e0eaa-335b-49a3-99ee-c101ab4cea0d None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:05.980279 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430fa45-8c32-472f-a569-791bcc7a8c11 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:06.009125 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:06.017525 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ffadd-c20c-40f3-9453-a451ce566ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:06.018646 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ffadd-c20c-40f3-9453-a451ce566ff1 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:06.019177 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ffadd-c20c-40f3-9453-a451ce566ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:06.019691 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ffadd-c20c-40f3-9453-a451ce566ff1 None admin] PATH_INFO: `/v3/users/07397da3682f4089a3c3c8d08484a85f` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:06.021121 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ffadd-c20c-40f3-9453-a451ce566ff1 None admin] RBAC: Authorizing `identity:get_user(user_id=07397da3682f4089a3c3c8d08484a85f)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:06.023063 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ffadd-c20c-40f3-9453-a451ce566ff1 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:06.029359 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 28/54] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:05 2022] GET /identity/v3/users/07397da3682f4089a3c3c8d08484a85f => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:05:06.030413 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ffadd-c20c-40f3-9453-a451ce566ff1 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:06.070709 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e0eaa-335b-49a3-99ee-c101ab4cea0d None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:06.103185 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd69ad-1a19-470b-944f-3658d82837d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:06.103781 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd69ad-1a19-470b-944f-3658d82837d3 None admin] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:06.104059 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd69ad-1a19-470b-944f-3658d82837d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:06.104338 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd69ad-1a19-470b-944f-3658d82837d3 None admin] PATH_INFO: `/v3/projects` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:06.104980 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd69ad-1a19-470b-944f-3658d82837d3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:06.106456 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd69ad-1a19-470b-944f-3658d82837d3 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:06.133403 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:06.136250 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 27/55] 10.222.0.20 () {60 vars in 1140 bytes} [Fri Sep 9 11:05:05 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:05:06.136815 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ffadd-c20c-40f3-9453-a451ce566ff1 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:06.176391 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9bcde-5f04-4505-ac01-c8ac71dfe970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:06.177054 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9bcde-5f04-4505-ac01-c8ac71dfe970 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:06.177208 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9bcde-5f04-4505-ac01-c8ac71dfe970 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:06.177513 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9bcde-5f04-4505-ac01-c8ac71dfe970 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:06.178700 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9bcde-5f04-4505-ac01-c8ac71dfe970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:06.180181 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9bcde-5f04-4505-ac01-c8ac71dfe970 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:06.182062 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 29/56] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:05:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:06.188081 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd69ad-1a19-470b-944f-3658d82837d3 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:06.290929 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:06.306782 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd69ad-1a19-470b-944f-3658d82837d3 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:06.347547 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c34a85-a807-4ce7-b7cb-fd43a2a4c709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:06.348482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c34a85-a807-4ce7-b7cb-fd43a2a4c709 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:06.348482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c34a85-a807-4ce7-b7cb-fd43a2a4c709 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:06.348713 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c34a85-a807-4ce7-b7cb-fd43a2a4c709 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:06.349495 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c34a85-a807-4ce7-b7cb-fd43a2a4c709 None admin] RBAC: Adding query filter params (role.id=b02ba8c157bf46f4a75cdab917db78db, scope.domain.id=default, user.id=07397da3682f4089a3c3c8d08484a85f) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:06.349809 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c34a85-a807-4ce7-b7cb-fd43a2a4c709 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:06.351294 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c34a85-a807-4ce7-b7cb-fd43a2a4c709 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:06.358002 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1322 bytes} [Fri Sep 9 11:05:06 2022] GET /identity/v3/role_assignments?user.id=07397da3682f4089a3c3c8d08484a85f&scope.domain.id=default&role.id=b02ba8c157bf46f4a75cdab917db78db => generated 530 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:08.579271 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81413e-e859-424f-8c9f-70117d220cd6 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:08.579794 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81413e-e859-424f-8c9f-70117d220cd6 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:08.579794 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81413e-e859-424f-8c9f-70117d220cd6 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:08.581107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 30/58] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:08.587166 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202db98-2b9e-4c6d-a5e1-5bb2068b6ff4 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:08.587613 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202db98-2b9e-4c6d-a5e1-5bb2068b6ff4 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:08.587712 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202db98-2b9e-4c6d-a5e1-5bb2068b6ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:08.607087 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-4202db98-2b9e-4c6d-a5e1-5bb2068b6ff4 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:08.608628 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-4202db98-2b9e-4c6d-a5e1-5bb2068b6ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:08.675484 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 29/59] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:08.996577 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81413e-e859-424f-8c9f-70117d220cd6 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:09.095656 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81413e-e859-424f-8c9f-70117d220cd6 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:09.127961 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3933d-6479-402c-9e02-70748830821a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:09.128584 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3933d-6479-402c-9e02-70748830821a None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:09.128864 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3933d-6479-402c-9e02-70748830821a None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:09.129135 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3933d-6479-402c-9e02-70748830821a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:09.130269 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b3933d-6479-402c-9e02-70748830821a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:09.131710 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b3933d-6479-402c-9e02-70748830821a None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:09.133252 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 31/60] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:05:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:09.138749 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202db98-2b9e-4c6d-a5e1-5bb2068b6ff4 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:09.222476 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:09.238555 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202db98-2b9e-4c6d-a5e1-5bb2068b6ff4 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:09.271574 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460d301-5b69-4830-9bb7-971483e14851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:09.272195 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460d301-5b69-4830-9bb7-971483e14851 None admin] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:09.272471 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460d301-5b69-4830-9bb7-971483e14851 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:09.272737 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460d301-5b69-4830-9bb7-971483e14851 None admin] PATH_INFO: `/v3/users` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:09.273434 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460d301-5b69-4830-9bb7-971483e14851 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:09.274888 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460d301-5b69-4830-9bb7-971483e14851 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:09.302689 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 30/61] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 9 11:05:09 2022] POST /identity/v3/users => generated 275 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:05:12.944814 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4c650-f0b4-449d-9c41-2473b33540e4 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:12.944814 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4c650-f0b4-449d-9c41-2473b33540e4 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:12.944814 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4c650-f0b4-449d-9c41-2473b33540e4 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:12.944814 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 32/62] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:12.950297 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86c5e0-570a-441f-b392-83fa85aa367f None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:12.950760 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86c5e0-570a-441f-b392-83fa85aa367f None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:12.950844 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86c5e0-570a-441f-b392-83fa85aa367f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:12.975154 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-9a86c5e0-570a-441f-b392-83fa85aa367f None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:12.976363 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-9a86c5e0-570a-441f-b392-83fa85aa367f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:13.067975 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 31/63] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:13.332817 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c6342-5970-4746-9dcb-52813115089d None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:13.332817 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c6342-5970-4746-9dcb-52813115089d None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:13.332817 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c6342-5970-4746-9dcb-52813115089d None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:13.332817 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 33/64] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:13.338459 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02ef00-7755-4e14-8fa1-563e8417246f None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:13.338975 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02ef00-7755-4e14-8fa1-563e8417246f None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:13.339448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02ef00-7755-4e14-8fa1-563e8417246f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:13.367100 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-3c02ef00-7755-4e14-8fa1-563e8417246f None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:13.367912 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d56e3c-226d-47df-bf9f-3ddc90c255de None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:13.368610 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d56e3c-226d-47df-bf9f-3ddc90c255de None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:13.368714 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-3c02ef00-7755-4e14-8fa1-563e8417246f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:13.369180 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d56e3c-226d-47df-bf9f-3ddc90c255de None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:13.370947 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 34/65] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:13.376435 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed2227-41e9-4e6b-bb2b-0e6c48e672f4 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:13.376996 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed2227-41e9-4e6b-bb2b-0e6c48e672f4 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:13.377537 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed2227-41e9-4e6b-bb2b-0e6c48e672f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:13.401878 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-afed2227-41e9-4e6b-bb2b-0e6c48e672f4 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:13.404185 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-afed2227-41e9-4e6b-bb2b-0e6c48e672f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:13.462984 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:13.497376 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 32/66] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:05:13.519613 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 35/67] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:05:13.529417 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02ef00-7755-4e14-8fa1-563e8417246f None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:13.533621 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:13.554896 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2d301-90ad-4d8f-bcbf-8b9e63a0c067 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:13.555192 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2d301-90ad-4d8f-bcbf-8b9e63a0c067 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:13.555480 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2d301-90ad-4d8f-bcbf-8b9e63a0c067 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:13.556804 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 36/68] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:13.562642 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac61c4a-50ed-47c0-8e01-2ea7caa3db10 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:13.562970 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac61c4a-50ed-47c0-8e01-2ea7caa3db10 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:13.563257 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac61c4a-50ed-47c0-8e01-2ea7caa3db10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:13.594034 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-2ac61c4a-50ed-47c0-8e01-2ea7caa3db10 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:13.595661 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-2ac61c4a-50ed-47c0-8e01-2ea7caa3db10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:13.688405 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02ef00-7755-4e14-8fa1-563e8417246f None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:13.697600 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 37/69] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:13.699068 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a4b34-a13e-4785-865d-dffd841250bb None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:13.699422 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a4b34-a13e-4785-865d-dffd841250bb None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:13.699708 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a4b34-a13e-4785-865d-dffd841250bb None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:13.700935 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 38/70] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:13.711250 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c169e62-f9b7-44a0-88ba-a28194145d1e None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:13.711711 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c169e62-f9b7-44a0-88ba-a28194145d1e None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:13.712060 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c169e62-f9b7-44a0-88ba-a28194145d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:13.732594 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-9c169e62-f9b7-44a0-88ba-a28194145d1e None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:13.733824 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-9c169e62-f9b7-44a0-88ba-a28194145d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:13.750753 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552d3d9-5783-4236-bf3a-946237eec683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:13.751424 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552d3d9-5783-4236-bf3a-946237eec683 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:13.751708 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552d3d9-5783-4236-bf3a-946237eec683 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:13.751986 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552d3d9-5783-4236-bf3a-946237eec683 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:13.771826 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552d3d9-5783-4236-bf3a-946237eec683 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:13.785712 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-7552d3d9-5783-4236-bf3a-946237eec683 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:05:13.785712 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:13.785712 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:13.785712 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:13.785712 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:13.785712 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:13.785712 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:13.785712 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:13.785712 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:13.785712 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:13.785712 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:13.785712 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:13.785712 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:13.785712 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:13.785712 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:13.785712 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:13.786703 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:13.786703 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:13.786703 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:13.786703 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:13.786703 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:13.786703 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:13.786703 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:13.786703 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:13.786703 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:13.786703 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:13.786703 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:13.786703 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:13.786703 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:13.786703 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:13.786703 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:13.786703 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:13.788151 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:13.788151 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:13.788151 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:13.788151 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:13.788151 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:13.788151 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:13.788151 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:13.788151 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:13.788151 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:13.788151 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:13.788151 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:05:13.788151 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:05:13.788151 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 33/71] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:05:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:05:13.792741 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552d3d9-5783-4236-bf3a-946237eec683 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:13.813582 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 39/72] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:13.866050 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c169e62-f9b7-44a0-88ba-a28194145d1e None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:13.885003 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:13.903359 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:13.941168 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552d3d9-5783-4236-bf3a-946237eec683 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:13.977552 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914354a0-c360-4b2e-8928-1d70b8be3618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:13.978197 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914354a0-c360-4b2e-8928-1d70b8be3618 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:13.978438 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914354a0-c360-4b2e-8928-1d70b8be3618 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:13.978715 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914354a0-c360-4b2e-8928-1d70b8be3618 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:13.979447 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914354a0-c360-4b2e-8928-1d70b8be3618 None admin] RBAC: Adding query filter params (name=member) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:13.979752 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914354a0-c360-4b2e-8928-1d70b8be3618 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:13.981439 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914354a0-c360-4b2e-8928-1d70b8be3618 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:13.994154 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 34/73] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 9 11:05:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:05:13.995093 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914354a0-c360-4b2e-8928-1d70b8be3618 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:14.008646 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c169e62-f9b7-44a0-88ba-a28194145d1e None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:14.059688 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c82913-44ac-4409-9345-7e57afbc598c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:14.060997 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c82913-44ac-4409-9345-7e57afbc598c None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:14.061823 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c82913-44ac-4409-9345-7e57afbc598c None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:14.062598 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c82913-44ac-4409-9345-7e57afbc598c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:14.082699 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c82913-44ac-4409-9345-7e57afbc598c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:14.091079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-a7c82913-44ac-4409-9345-7e57afbc598c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:05:14.091079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:14.091079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:14.091079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:14.091079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:14.091079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:14.091079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:14.091079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:14.091079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:14.091079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:14.091079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:14.091079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:14.091079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:14.091079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:14.091079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:14.091079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:14.091927 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:14.091927 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:14.091927 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:14.091927 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:14.091927 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:14.091927 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:14.091927 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:14.091927 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:14.091927 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:14.091927 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:14.091927 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:14.091927 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:14.091927 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:14.091927 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:14.091927 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:14.091927 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:14.092672 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:14.092672 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:14.092672 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:14.092672 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:14.092672 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:14.092672 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:14.092672 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:14.092672 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:14.092672 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:14.092672 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:14.092672 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:05:14.092672 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:05:14.094690 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 40/74] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 9 11:05:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:05:14.095570 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c82913-44ac-4409-9345-7e57afbc598c None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:14.110398 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914354a0-c360-4b2e-8928-1d70b8be3618 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:14.141154 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:14.153243 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df2800-150f-42d0-bf04-883d99948944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:14.153933 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df2800-150f-42d0-bf04-883d99948944 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:14.154216 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df2800-150f-42d0-bf04-883d99948944 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:14.154490 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df2800-150f-42d0-bf04-883d99948944 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:14.167254 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df2800-150f-42d0-bf04-883d99948944 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:14.173968 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-54df2800-150f-42d0-bf04-883d99948944 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:05:14.173968 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:14.173968 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:14.173968 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:14.173968 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:14.173968 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:14.173968 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:14.173968 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:14.173968 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:14.173968 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:14.173968 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:14.173968 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:14.173968 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:14.173968 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:14.173968 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:14.173968 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:14.174917 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:14.174917 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:14.174917 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:14.174917 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:14.174917 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:14.174917 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:14.174917 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:14.174917 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:14.174917 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:14.174917 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:14.174917 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:14.174917 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:14.174917 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:14.174917 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:14.174917 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:14.174917 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:14.175672 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:14.175672 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:14.175672 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:14.175672 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:14.175672 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:14.175672 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:14.175672 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:14.175672 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:14.175672 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:14.175672 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:14.175672 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:05:14.175672 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:05:14.175672 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 35/75] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 9 11:05:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:05:14.177195 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df2800-150f-42d0-bf04-883d99948944 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:14.205097 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:14.221205 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c82913-44ac-4409-9345-7e57afbc598c None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:14.260754 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff6006-dbae-4df5-80c6-01d2601c55f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:14.261678 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff6006-dbae-4df5-80c6-01d2601c55f9 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:14.261981 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff6006-dbae-4df5-80c6-01d2601c55f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:14.262435 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff6006-dbae-4df5-80c6-01d2601c55f9 None admin] PATH_INFO: `/v3/users/ffaf170d5bc6440caacc8723c5238029` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:14.283109 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff6006-dbae-4df5-80c6-01d2601c55f9 None admin] RBAC: Authorizing `identity:get_user(user_id=ffaf170d5bc6440caacc8723c5238029)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:14.284688 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff6006-dbae-4df5-80c6-01d2601c55f9 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:14.286428 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df2800-150f-42d0-bf04-883d99948944 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:14.286543 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 41/76] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:14 2022] GET /identity/v3/users/ffaf170d5bc6440caacc8723c5238029 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:14.292467 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff6006-dbae-4df5-80c6-01d2601c55f9 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:14.336581 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22bc3f-eaa6-4960-aee6-d47b28ca4178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:14.337198 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22bc3f-eaa6-4960-aee6-d47b28ca4178 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:14.337514 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22bc3f-eaa6-4960-aee6-d47b28ca4178 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:14.337790 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22bc3f-eaa6-4960-aee6-d47b28ca4178 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:14.338453 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22bc3f-eaa6-4960-aee6-d47b28ca4178 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:14.338802 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22bc3f-eaa6-4960-aee6-d47b28ca4178 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:14.340187 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22bc3f-eaa6-4960-aee6-d47b28ca4178 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:14.350127 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 36/77] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:05:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:14.353038 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22bc3f-eaa6-4960-aee6-d47b28ca4178 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:14.398573 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff6006-dbae-4df5-80c6-01d2601c55f9 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:14.399164 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:14.432745 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d9e0e-700d-4af8-a9c8-9aa2b43973fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:14.433402 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d9e0e-700d-4af8-a9c8-9aa2b43973fc None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:14.433690 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d9e0e-700d-4af8-a9c8-9aa2b43973fc None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:14.433964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d9e0e-700d-4af8-a9c8-9aa2b43973fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:14.445015 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0d9e0e-700d-4af8-a9c8-9aa2b43973fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:14.449941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-5b0d9e0e-700d-4af8-a9c8-9aa2b43973fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:05:14.449941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:14.449941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:14.449941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:14.449941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:14.449941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:14.449941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:14.449941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:14.449941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:14.449941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:14.449941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:14.449941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:14.449941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:14.449941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:14.449941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:14.449941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:14.450848 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:14.450848 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:14.450848 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:14.450848 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:14.450848 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:14.450848 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:14.450848 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:14.450848 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:14.450848 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:14.450848 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:14.450848 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:14.450848 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:14.450848 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:14.450848 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:14.450848 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:14.450848 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:14.451605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:14.451605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:14.451605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:14.451605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:14.451605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:14.451605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:14.451605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:14.451605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:14.451605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:14.451605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:14.451605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:05:14.451605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:05:14.451605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 42/78] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:05:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:05:14.453305 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d9e0e-700d-4af8-a9c8-9aa2b43973fc None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:14.453720 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22bc3f-eaa6-4960-aee6-d47b28ca4178 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:14.458172 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:14.488816 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfeffe0-f5df-4545-ab5a-969e445e9196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:14.489471 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfeffe0-f5df-4545-ab5a-969e445e9196 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:14.489757 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfeffe0-f5df-4545-ab5a-969e445e9196 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:14.490032 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfeffe0-f5df-4545-ab5a-969e445e9196 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:14.490694 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfeffe0-f5df-4545-ab5a-969e445e9196 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:14.490993 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfeffe0-f5df-4545-ab5a-969e445e9196 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:14.492377 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfeffe0-f5df-4545-ab5a-969e445e9196 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:14.500881 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 37/79] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:05:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:14.501723 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfeffe0-f5df-4545-ab5a-969e445e9196 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:14.560291 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d9e0e-700d-4af8-a9c8-9aa2b43973fc None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:14.595229 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f6fd3-fadc-4c35-9346-78bee4c0e956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:14.595856 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f6fd3-fadc-4c35-9346-78bee4c0e956 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:14.596141 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f6fd3-fadc-4c35-9346-78bee4c0e956 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:14.596427 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f6fd3-fadc-4c35-9346-78bee4c0e956 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:14.597584 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f6fd3-fadc-4c35-9346-78bee4c0e956 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:14.599040 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f6fd3-fadc-4c35-9346-78bee4c0e956 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:14.599145 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfeffe0-f5df-4545-ab5a-969e445e9196 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:14.600607 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 43/80] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:05:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:14.601962 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f6fd3-fadc-4c35-9346-78bee4c0e956 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:14.608774 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:14.633907 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31f768-c9c1-4fe3-aee9-8cf589bd69fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:14.634519 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31f768-c9c1-4fe3-aee9-8cf589bd69fc None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:14.634795 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31f768-c9c1-4fe3-aee9-8cf589bd69fc None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:14.635067 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31f768-c9c1-4fe3-aee9-8cf589bd69fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:14.674993 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:14.701820 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31f768-c9c1-4fe3-aee9-8cf589bd69fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:14.703384 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31f768-c9c1-4fe3-aee9-8cf589bd69fc None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:14.704197 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f6fd3-fadc-4c35-9346-78bee4c0e956 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:14.738037 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d1b7b-cd0e-4de7-8f8b-c407913d11ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:14.738666 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d1b7b-cd0e-4de7-8f8b-c407913d11ff None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:14.738945 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d1b7b-cd0e-4de7-8f8b-c407913d11ff None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:14.739218 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d1b7b-cd0e-4de7-8f8b-c407913d11ff None admin] PATH_INFO: `/v3/users/07397da3682f4089a3c3c8d08484a85f` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:14.740335 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d1b7b-cd0e-4de7-8f8b-c407913d11ff None admin] RBAC: Authorizing `identity:get_user(user_id=07397da3682f4089a3c3c8d08484a85f)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:14.741829 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d1b7b-cd0e-4de7-8f8b-c407913d11ff None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:14.743389 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 44/81] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:14 2022] GET /identity/v3/users/07397da3682f4089a3c3c8d08484a85f => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:14.744140 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d1b7b-cd0e-4de7-8f8b-c407913d11ff None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:14.805586 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 38/82] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:05:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:05:14.811042 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31f768-c9c1-4fe3-aee9-8cf589bd69fc None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:14.821014 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:14.846154 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d1b7b-cd0e-4de7-8f8b-c407913d11ff None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:14.884569 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f6e02-f707-405b-b4f3-5c462d71a791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:14.885197 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f6e02-f707-405b-b4f3-5c462d71a791 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:14.885518 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f6e02-f707-405b-b4f3-5c462d71a791 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:14.885799 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f6e02-f707-405b-b4f3-5c462d71a791 None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:14.886491 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f6e02-f707-405b-b4f3-5c462d71a791 None admin] RBAC: Adding query filter params (name=member) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:14.886788 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f6e02-f707-405b-b4f3-5c462d71a791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:14.889326 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f6e02-f707-405b-b4f3-5c462d71a791 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:14.905198 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 45/83] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 9 11:05:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:14.905198 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f6e02-f707-405b-b4f3-5c462d71a791 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:14.908601 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:14.925755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31f768-c9c1-4fe3-aee9-8cf589bd69fc None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:14.970166 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c764fc-e482-435a-a319-bec7856e8c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:14.971359 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c764fc-e482-435a-a319-bec7856e8c71 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:14.971639 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c764fc-e482-435a-a319-bec7856e8c71 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:14.972024 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c764fc-e482-435a-a319-bec7856e8c71 None admin] PATH_INFO: `/v3/users/ffaf170d5bc6440caacc8723c5238029` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:14.973184 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c764fc-e482-435a-a319-bec7856e8c71 None admin] RBAC: Authorizing `identity:get_user(user_id=ffaf170d5bc6440caacc8723c5238029)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:14.974779 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c764fc-e482-435a-a319-bec7856e8c71 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:14.977453 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 39/84] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:14 2022] GET /identity/v3/users/ffaf170d5bc6440caacc8723c5238029 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:14.977453 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c764fc-e482-435a-a319-bec7856e8c71 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:15.023551 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f6e02-f707-405b-b4f3-5c462d71a791 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:15.064677 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:15.065680 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6b9bb-de3b-4461-9b7a-4786f618755c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:15.066237 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6b9bb-de3b-4461-9b7a-4786f618755c None admin] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:15.066690 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6b9bb-de3b-4461-9b7a-4786f618755c None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:15.067114 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6b9bb-de3b-4461-9b7a-4786f618755c None admin] PATH_INFO: `/v3/users` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:15.067772 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6b9bb-de3b-4461-9b7a-4786f618755c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:15.069232 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6b9bb-de3b-4461-9b7a-4786f618755c None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:15.095583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c764fc-e482-435a-a319-bec7856e8c71 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:15.109680 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 46/85] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 9 11:05:14 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:05:15.112724 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6b9bb-de3b-4461-9b7a-4786f618755c None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:15.149116 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe2da0-0520-44a4-9a56-ec2aa4fc4914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:15.149778 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe2da0-0520-44a4-9a56-ec2aa4fc4914 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:15.150053 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe2da0-0520-44a4-9a56-ec2aa4fc4914 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:15.150325 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe2da0-0520-44a4-9a56-ec2aa4fc4914 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:15.202217 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:15.249797 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe2da0-0520-44a4-9a56-ec2aa4fc4914 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:15.251853 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe2da0-0520-44a4-9a56-ec2aa4fc4914 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:15.258423 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6b9bb-de3b-4461-9b7a-4786f618755c None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:15.300721 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba9719-a75c-4994-9e44-d7b5bbba2d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:15.300721 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba9719-a75c-4994-9e44-d7b5bbba2d19 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:15.300721 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba9719-a75c-4994-9e44-d7b5bbba2d19 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:15.300721 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba9719-a75c-4994-9e44-d7b5bbba2d19 None admin] PATH_INFO: `/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:15.301156 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba9719-a75c-4994-9e44-d7b5bbba2d19 None admin] RBAC: Authorizing `identity:get_project(project_id=b614dbb6ad10435abe1ffe4e9071d2e3)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:15.302379 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba9719-a75c-4994-9e44-d7b5bbba2d19 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:15.304365 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 47/86] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:05:15 2022] GET /identity/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:15.305105 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba9719-a75c-4994-9e44-d7b5bbba2d19 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:15.357697 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:15.391449 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 40/87] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:05:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:05:15.392482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe2da0-0520-44a4-9a56-ec2aa4fc4914 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:15.442859 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba9719-a75c-4994-9e44-d7b5bbba2d19 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:15.476989 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:15.494789 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c5082-1460-4ee4-a83b-5217f82b9944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:15.495612 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c5082-1460-4ee4-a83b-5217f82b9944 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:15.495900 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c5082-1460-4ee4-a83b-5217f82b9944 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:15.496172 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c5082-1460-4ee4-a83b-5217f82b9944 None admin] PATH_INFO: `/v3/users/ffaf170d5bc6440caacc8723c5238029` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:15.497380 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c5082-1460-4ee4-a83b-5217f82b9944 None admin] RBAC: Authorizing `identity:get_user(user_id=ffaf170d5bc6440caacc8723c5238029)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:15.498840 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c5082-1460-4ee4-a83b-5217f82b9944 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:15.501141 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 48/88] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:15 2022] GET /identity/v3/users/ffaf170d5bc6440caacc8723c5238029 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:15.501862 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c5082-1460-4ee4-a83b-5217f82b9944 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:15.542355 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe2da0-0520-44a4-9a56-ec2aa4fc4914 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:15.591104 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfda18-b5a8-4a64-b7da-44b2beb403d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:15.592147 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfda18-b5a8-4a64-b7da-44b2beb403d6 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:15.592730 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfda18-b5a8-4a64-b7da-44b2beb403d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:15.593204 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfda18-b5a8-4a64-b7da-44b2beb403d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:15.643296 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c5082-1460-4ee4-a83b-5217f82b9944 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:15.659925 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:15.691024 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b252762-857f-4b38-adad-9f33e5b959a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:15.691655 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b252762-857f-4b38-adad-9f33e5b959a2 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:15.691967 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b252762-857f-4b38-adad-9f33e5b959a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:15.692288 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b252762-857f-4b38-adad-9f33e5b959a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:15.692825 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cfda18-b5a8-4a64-b7da-44b2beb403d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:15.693087 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b252762-857f-4b38-adad-9f33e5b959a2 None admin] RBAC: Adding query filter params (role.id=cf09a959c760483db0dff049f84e5482, scope.project.id=b614dbb6ad10435abe1ffe4e9071d2e3, user.id=ffaf170d5bc6440caacc8723c5238029) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:15.693476 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b252762-857f-4b38-adad-9f33e5b959a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:15.695060 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b252762-857f-4b38-adad-9f33e5b959a2 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:15.695992 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cfda18-b5a8-4a64-b7da-44b2beb403d6 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:15.706609 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 49/89] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:05:15 2022] GET /identity/v3/role_assignments?user.id=ffaf170d5bc6440caacc8723c5238029&scope.project.id=b614dbb6ad10435abe1ffe4e9071d2e3&role.id=cf09a959c760483db0dff049f84e5482 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:15.707307 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b252762-857f-4b38-adad-9f33e5b959a2 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:15.784290 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:15.878639 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b252762-857f-4b38-adad-9f33e5b959a2 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:15.894455 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 41/90] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:05:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:05:15.896706 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfda18-b5a8-4a64-b7da-44b2beb403d6 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:15.926948 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2071730-224d-4a72-8609-3fc399f63ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:15.927890 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2071730-224d-4a72-8609-3fc399f63ca6 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:15.928032 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2071730-224d-4a72-8609-3fc399f63ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:15.928274 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2071730-224d-4a72-8609-3fc399f63ca6 None admin] PATH_INFO: `/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:15.929681 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2071730-224d-4a72-8609-3fc399f63ca6 None admin] RBAC: Authorizing `identity:get_project(project_id=b614dbb6ad10435abe1ffe4e9071d2e3)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:15.931215 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2071730-224d-4a72-8609-3fc399f63ca6 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:15.936951 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 50/91] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:05:15 2022] GET /identity/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:15.936951 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2071730-224d-4a72-8609-3fc399f63ca6 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:16.043620 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:16.074890 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfda18-b5a8-4a64-b7da-44b2beb403d6 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:16.102890 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2071730-224d-4a72-8609-3fc399f63ca6 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:16.138626 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:16.142764 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805db5f-c87f-4557-ab3e-7e02eda7adfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:16.143724 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805db5f-c87f-4557-ab3e-7e02eda7adfb None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:16.145026 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805db5f-c87f-4557-ab3e-7e02eda7adfb None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:16.145781 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805db5f-c87f-4557-ab3e-7e02eda7adfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:16.163696 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a86def-f76a-4603-8e80-1585acfe4ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:16.164777 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a86def-f76a-4603-8e80-1585acfe4ddf None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:16.165259 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a86def-f76a-4603-8e80-1585acfe4ddf None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:16.165768 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a86def-f76a-4603-8e80-1585acfe4ddf None admin] PATH_INFO: `/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:16.167121 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a86def-f76a-4603-8e80-1585acfe4ddf None admin] RBAC: Authorizing `identity:get_project(project_id=b614dbb6ad10435abe1ffe4e9071d2e3)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:16.170669 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a86def-f76a-4603-8e80-1585acfe4ddf None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:16.174728 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 51/92] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:05:15 2022] GET /identity/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:16.176061 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a86def-f76a-4603-8e80-1585acfe4ddf None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:16.296540 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805db5f-c87f-4557-ab3e-7e02eda7adfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:16.300388 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805db5f-c87f-4557-ab3e-7e02eda7adfb None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:16.398712 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:16.418612 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a86def-f76a-4603-8e80-1585acfe4ddf None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:16.443637 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 42/93] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:05:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:05:16.448441 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805db5f-c87f-4557-ab3e-7e02eda7adfb None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:16.465326 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a99aa6-75d9-472c-a2ca-7846a5dbb4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:16.465326 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a99aa6-75d9-472c-a2ca-7846a5dbb4ef None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:16.465326 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a99aa6-75d9-472c-a2ca-7846a5dbb4ef None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:16.465326 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a99aa6-75d9-472c-a2ca-7846a5dbb4ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:16.466010 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a99aa6-75d9-472c-a2ca-7846a5dbb4ef None admin] RBAC: Adding query filter params (role.id=b02ba8c157bf46f4a75cdab917db78db, scope.project.id=b614dbb6ad10435abe1ffe4e9071d2e3, user.id=07397da3682f4089a3c3c8d08484a85f) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:16.466331 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a99aa6-75d9-472c-a2ca-7846a5dbb4ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:16.467963 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a99aa6-75d9-472c-a2ca-7846a5dbb4ef None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:16.475247 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 52/94] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:05:16 2022] GET /identity/v3/role_assignments?user.id=07397da3682f4089a3c3c8d08484a85f&scope.project.id=b614dbb6ad10435abe1ffe4e9071d2e3&role.id=b02ba8c157bf46f4a75cdab917db78db => generated 259 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:16.476071 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a99aa6-75d9-472c-a2ca-7846a5dbb4ef None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:16.592633 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:16.641527 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a99aa6-75d9-472c-a2ca-7846a5dbb4ef None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:16.683020 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c837d-dcbc-4e0a-b3be-32f0d8ad0195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:16.683677 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c837d-dcbc-4e0a-b3be-32f0d8ad0195 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:16.683963 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c837d-dcbc-4e0a-b3be-32f0d8ad0195 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:16.684252 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c837d-dcbc-4e0a-b3be-32f0d8ad0195 None admin] PATH_INFO: `/v3/projects/95dedf4bd2a84c88ac419fdc8b12b002` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:16.685470 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c837d-dcbc-4e0a-b3be-32f0d8ad0195 None admin] RBAC: Authorizing `identity:get_project(project_id=95dedf4bd2a84c88ac419fdc8b12b002)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:16.687088 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c837d-dcbc-4e0a-b3be-32f0d8ad0195 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:16.689667 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 53/95] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:05:16 2022] GET /identity/v3/projects/95dedf4bd2a84c88ac419fdc8b12b002 => generated 312 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:16.695888 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c837d-dcbc-4e0a-b3be-32f0d8ad0195 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:16.728032 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805db5f-c87f-4557-ab3e-7e02eda7adfb None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:16.815606 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c837d-dcbc-4e0a-b3be-32f0d8ad0195 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:16.835534 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aad8b1-70c5-4126-9e7c-29a3cab5119d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:16.836477 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aad8b1-70c5-4126-9e7c-29a3cab5119d None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:16.836942 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aad8b1-70c5-4126-9e7c-29a3cab5119d None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:16.837418 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aad8b1-70c5-4126-9e7c-29a3cab5119d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:16.838393 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aad8b1-70c5-4126-9e7c-29a3cab5119d None admin] RBAC: Adding query filter params (role.id=60e15fc9c58142f9907a923f384849cc, scope.project.id=b614dbb6ad10435abe1ffe4e9071d2e3, user.id=ffaf170d5bc6440caacc8723c5238029) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:16.838909 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aad8b1-70c5-4126-9e7c-29a3cab5119d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:16.840666 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aad8b1-70c5-4126-9e7c-29a3cab5119d None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:16.853438 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:16.857241 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 43/96] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:05:16 2022] GET /identity/v3/role_assignments?user.id=ffaf170d5bc6440caacc8723c5238029&scope.project.id=b614dbb6ad10435abe1ffe4e9071d2e3&role.id=60e15fc9c58142f9907a923f384849cc => generated 259 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:16.858000 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205a161-595c-4a97-90cf-4a54d87c5ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:16.858735 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205a161-595c-4a97-90cf-4a54d87c5ea5 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:16.859109 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205a161-595c-4a97-90cf-4a54d87c5ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:16.859522 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205a161-595c-4a97-90cf-4a54d87c5ea5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:16.860551 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205a161-595c-4a97-90cf-4a54d87c5ea5 None admin] RBAC: Adding query filter params (role.id=cf09a959c760483db0dff049f84e5482, scope.project.id=95dedf4bd2a84c88ac419fdc8b12b002, user.id=ffaf170d5bc6440caacc8723c5238029) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:16.860720 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205a161-595c-4a97-90cf-4a54d87c5ea5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:16.862448 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205a161-595c-4a97-90cf-4a54d87c5ea5 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:16.870023 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 54/97] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:05:16 2022] GET /identity/v3/role_assignments?user.id=ffaf170d5bc6440caacc8723c5238029&scope.project.id=95dedf4bd2a84c88ac419fdc8b12b002&role.id=cf09a959c760483db0dff049f84e5482 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:05:18.611209 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a4d1c-d487-419e-bff3-95f8420ffb4d None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:18.611736 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a4d1c-d487-419e-bff3-95f8420ffb4d None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:18.611736 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a4d1c-d487-419e-bff3-95f8420ffb4d None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:18.613057 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 44/98] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:18.631807 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1099d30-a223-43a7-85a2-7edb738ff2fb None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:18.632324 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1099d30-a223-43a7-85a2-7edb738ff2fb None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:18.632396 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1099d30-a223-43a7-85a2-7edb738ff2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:18.652178 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-d1099d30-a223-43a7-85a2-7edb738ff2fb None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:18.657667 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-d1099d30-a223-43a7-85a2-7edb738ff2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:18.748374 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 55/99] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:19.252871 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0c885-abb9-45bb-a9a5-81cc9b5d610d None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:19.253250 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0c885-abb9-45bb-a9a5-81cc9b5d610d None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:19.253503 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0c885-abb9-45bb-a9a5-81cc9b5d610d None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:19.255111 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 45/100] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:19.268060 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1840a-eb68-43d4-80a5-a78df97ed616 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:19.268377 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1840a-eb68-43d4-80a5-a78df97ed616 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:19.268629 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1840a-eb68-43d4-80a5-a78df97ed616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:19.287918 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-d0c1840a-eb68-43d4-80a5-a78df97ed616 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:19.289155 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-d0c1840a-eb68-43d4-80a5-a78df97ed616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:19.352463 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0c885-abb9-45bb-a9a5-81cc9b5d610d None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:19.388627 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 56/101] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:19.421311 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:19.494266 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38827c58-4b5c-4f5b-90d8-9bbe961857f5 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:19.494581 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38827c58-4b5c-4f5b-90d8-9bbe961857f5 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:19.494834 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38827c58-4b5c-4f5b-90d8-9bbe961857f5 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:19.496261 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 57/102] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:05:19.505888 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97abce7-11ae-433a-bbd7-5b91f338940d None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:19.506138 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97abce7-11ae-433a-bbd7-5b91f338940d None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:19.506487 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97abce7-11ae-433a-bbd7-5b91f338940d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:19.525616 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0c885-abb9-45bb-a9a5-81cc9b5d610d None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:19.537105 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-f97abce7-11ae-433a-bbd7-5b91f338940d None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:19.538370 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-f97abce7-11ae-433a-bbd7-5b91f338940d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:19.605713 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bd34f-5c5d-4888-86e6-9969b7c26be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:19.606369 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bd34f-5c5d-4888-86e6-9969b7c26be9 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:19.606657 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bd34f-5c5d-4888-86e6-9969b7c26be9 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:19.606933 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bd34f-5c5d-4888-86e6-9969b7c26be9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:19.638324 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0bd34f-5c5d-4888-86e6-9969b7c26be9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:19.643873 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-1a0bd34f-5c5d-4888-86e6-9969b7c26be9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:05:19.643873 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:19.643873 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:19.643873 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:19.643873 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:19.643873 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:19.643873 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:19.643873 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:19.643873 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:19.643873 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:19.643873 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:19.643873 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:19.643873 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:19.643873 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:19.643873 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:19.643873 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:19.645152 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:19.645152 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:19.645152 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:19.645152 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:19.645152 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:19.645152 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:19.645152 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:19.645152 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:19.645152 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:19.645152 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:19.645152 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:19.645152 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:19.645152 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:19.645152 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:19.645152 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:19.645152 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:19.646289 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:19.646289 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:19.646289 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:19.646289 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:19.646289 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:19.646289 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:19.646289 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:19.646289 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:19.646289 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:19.646289 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:19.646289 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:05:19.646289 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:05:19.646289 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 46/103] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:05:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:05:19.654982 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bd34f-5c5d-4888-86e6-9969b7c26be9 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:19.656364 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:19.725547 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 58/104] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:19.810149 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:19.813189 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bd34f-5c5d-4888-86e6-9969b7c26be9 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:19.821035 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97abce7-11ae-433a-bbd7-5b91f338940d None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:19.870973 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68c415-b7ed-4fa5-9ce0-07199bc1b4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:19.871601 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68c415-b7ed-4fa5-9ce0-07199bc1b4fa None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:19.871891 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68c415-b7ed-4fa5-9ce0-07199bc1b4fa None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:19.872171 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68c415-b7ed-4fa5-9ce0-07199bc1b4fa None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:19.872847 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68c415-b7ed-4fa5-9ce0-07199bc1b4fa None admin] RBAC: Adding query filter params (name=reader) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:19.873155 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68c415-b7ed-4fa5-9ce0-07199bc1b4fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:19.874608 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68c415-b7ed-4fa5-9ce0-07199bc1b4fa None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:19.895628 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 47/105] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 9 11:05:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:19.915604 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68c415-b7ed-4fa5-9ce0-07199bc1b4fa None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:19.948357 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97abce7-11ae-433a-bbd7-5b91f338940d None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:19.994628 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80a3d4-b322-463c-9e3e-0b6730ffa75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:19.995668 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80a3d4-b322-463c-9e3e-0b6730ffa75e None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:19.996179 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80a3d4-b322-463c-9e3e-0b6730ffa75e None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:19.996643 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80a3d4-b322-463c-9e3e-0b6730ffa75e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:20.020346 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80a3d4-b322-463c-9e3e-0b6730ffa75e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:20.034783 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-1e80a3d4-b322-463c-9e3e-0b6730ffa75e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:05:20.034783 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:20.034783 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:20.034783 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:20.034783 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:20.034783 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:20.034783 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:20.034783 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:20.034783 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:20.034783 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:20.034783 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:20.034783 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:20.034783 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:20.034783 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:20.034783 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:20.034783 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:20.036171 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:20.036171 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:20.036171 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:20.036171 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:20.036171 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:20.036171 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:20.036171 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:20.036171 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:20.036171 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:20.036171 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:20.036171 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:20.036171 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:20.036171 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:20.036171 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:20.036171 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:20.036171 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:20.036937 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:20.036937 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:20.036937 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:20.036937 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:20.036937 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:20.036937 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:20.036937 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:20.036937 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:20.036937 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:20.036937 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:20.036937 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:05:20.036937 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:05:20.039793 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 59/106] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:05:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:05:20.046375 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80a3d4-b322-463c-9e3e-0b6730ffa75e None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:20.112475 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:20.195305 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68c415-b7ed-4fa5-9ce0-07199bc1b4fa None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:20.244473 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80a3d4-b322-463c-9e3e-0b6730ffa75e None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:20.258086 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc28435-3c78-40eb-870a-4931a75c7263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:20.258829 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc28435-3c78-40eb-870a-4931a75c7263 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:20.259125 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc28435-3c78-40eb-870a-4931a75c7263 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:20.259454 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc28435-3c78-40eb-870a-4931a75c7263 None admin] PATH_INFO: `/v3/users/f818baec5a1644659267f10e55e30941` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:20.278331 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc28435-3c78-40eb-870a-4931a75c7263 None admin] RBAC: Authorizing `identity:get_user(user_id=f818baec5a1644659267f10e55e30941)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:20.279841 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc28435-3c78-40eb-870a-4931a75c7263 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:20.281944 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 48/107] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:19 2022] GET /identity/v3/users/f818baec5a1644659267f10e55e30941 => generated 289 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:05:20.288332 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7729b-4166-4cfa-9e2f-43914843ffa7 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:20.288332 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7729b-4166-4cfa-9e2f-43914843ffa7 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:20.288332 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7729b-4166-4cfa-9e2f-43914843ffa7 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:20.288332 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 49/108] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:20.288332 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7729b-4166-4cfa-9e2f-43914843ffa7 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:20.311149 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041868f-0839-44e0-86e7-33330d3df5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:20.312144 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041868f-0839-44e0-86e7-33330d3df5a5 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:20.313212 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041868f-0839-44e0-86e7-33330d3df5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:20.313739 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041868f-0839-44e0-86e7-33330d3df5a5 None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:20.314646 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041868f-0839-44e0-86e7-33330d3df5a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:20.315163 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041868f-0839-44e0-86e7-33330d3df5a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:20.316803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041868f-0839-44e0-86e7-33330d3df5a5 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:20.321843 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:20.327882 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 60/109] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 9 11:05:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:05:20.334778 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246e872-f580-4a4d-9250-e4bcc1c70b96 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:20.335307 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246e872-f580-4a4d-9250-e4bcc1c70b96 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:20.335779 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246e872-f580-4a4d-9250-e4bcc1c70b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:20.355804 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-5246e872-f580-4a4d-9250-e4bcc1c70b96 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:20.357466 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-5246e872-f580-4a4d-9250-e4bcc1c70b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:20.418363 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7729b-4166-4cfa-9e2f-43914843ffa7 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:20.453310 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 61/110] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:20.453310 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5246e872-f580-4a4d-9250-e4bcc1c70b96 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:20.483247 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d37b7b-9029-4eea-8fab-4e7384bc523a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:20.485068 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d37b7b-9029-4eea-8fab-4e7384bc523a None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:20.486097 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d37b7b-9029-4eea-8fab-4e7384bc523a None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:20.486386 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d37b7b-9029-4eea-8fab-4e7384bc523a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:20.487748 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d37b7b-9029-4eea-8fab-4e7384bc523a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:20.491577 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d37b7b-9029-4eea-8fab-4e7384bc523a None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:20.494394 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 50/111] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:05:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:20.495091 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d37b7b-9029-4eea-8fab-4e7384bc523a None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:20.512089 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:20.653148 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5246e872-f580-4a4d-9250-e4bcc1c70b96 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:20.674870 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:20.691488 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d37b7b-9029-4eea-8fab-4e7384bc523a None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:20.735772 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad7d44-3d34-4f04-92d7-95d966b83602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:20.736858 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad7d44-3d34-4f04-92d7-95d966b83602 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:20.737389 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad7d44-3d34-4f04-92d7-95d966b83602 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:20.737960 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad7d44-3d34-4f04-92d7-95d966b83602 None admin] PATH_INFO: `/v3/users/ffaf170d5bc6440caacc8723c5238029` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:20.738208 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638de355-232d-4745-a0a8-cd0cf9596476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:20.738847 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638de355-232d-4745-a0a8-cd0cf9596476 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:20.739133 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638de355-232d-4745-a0a8-cd0cf9596476 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:20.739410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638de355-232d-4745-a0a8-cd0cf9596476 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:20.740822 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad7d44-3d34-4f04-92d7-95d966b83602 None admin] RBAC: Authorizing `identity:get_user(user_id=ffaf170d5bc6440caacc8723c5238029)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:20.743085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad7d44-3d34-4f04-92d7-95d966b83602 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:20.746035 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 51/112] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:20 2022] GET /identity/v3/users/ffaf170d5bc6440caacc8723c5238029 => generated 275 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:20.751853 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad7d44-3d34-4f04-92d7-95d966b83602 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:20.829426 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638de355-232d-4745-a0a8-cd0cf9596476 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:20.831573 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638de355-232d-4745-a0a8-cd0cf9596476 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:20.868308 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:20.876325 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad7d44-3d34-4f04-92d7-95d966b83602 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:20.913319 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9b8fd-57b4-43ec-99a7-3a0215d14483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:20.914187 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9b8fd-57b4-43ec-99a7-3a0215d14483 None admin] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:20.914465 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9b8fd-57b4-43ec-99a7-3a0215d14483 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:20.914736 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9b8fd-57b4-43ec-99a7-3a0215d14483 None admin] PATH_INFO: `/v3/projects` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:20.915387 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9b8fd-57b4-43ec-99a7-3a0215d14483 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:20.916954 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9b8fd-57b4-43ec-99a7-3a0215d14483 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:20.948146 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 62/113] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:05:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:05:20.948146 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef85ac-4692-4aec-8868-75720fe86249 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:20.948146 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef85ac-4692-4aec-8868-75720fe86249 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:20.948146 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef85ac-4692-4aec-8868-75720fe86249 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:20.948146 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 63/114] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:20.948146 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef85ac-4692-4aec-8868-75720fe86249 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:20.961421 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 52/115] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 9 11:05:20 2022] POST /identity/v3/projects => generated 302 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:05:20.961421 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9b8fd-57b4-43ec-99a7-3a0215d14483 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:20.975235 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:21.074325 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef85ac-4692-4aec-8868-75720fe86249 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:21.118748 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:21.120606 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9b8fd-57b4-43ec-99a7-3a0215d14483 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:21.130511 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f08e36-fd25-49b2-9f50-0f5c12a90bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:21.131604 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f08e36-fd25-49b2-9f50-0f5c12a90bb6 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:21.132696 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f08e36-fd25-49b2-9f50-0f5c12a90bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:21.133226 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f08e36-fd25-49b2-9f50-0f5c12a90bb6 None admin] PATH_INFO: `/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:21.135568 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f08e36-fd25-49b2-9f50-0f5c12a90bb6 None admin] RBAC: Authorizing `identity:get_project(project_id=b614dbb6ad10435abe1ffe4e9071d2e3)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:21.138323 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f08e36-fd25-49b2-9f50-0f5c12a90bb6 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:21.146423 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 64/116] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:05:20 2022] GET /identity/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:21.147805 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f08e36-fd25-49b2-9f50-0f5c12a90bb6 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:21.178035 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7dbbf-e809-4f86-82cc-1289a4af9a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:21.179015 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7dbbf-e809-4f86-82cc-1289a4af9a87 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:21.179324 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7dbbf-e809-4f86-82cc-1289a4af9a87 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:21.179632 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7dbbf-e809-4f86-82cc-1289a4af9a87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:21.195172 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7dbbf-e809-4f86-82cc-1289a4af9a87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:21.201134 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-3ab7dbbf-e809-4f86-82cc-1289a4af9a87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:05:21.201134 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:21.201134 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:21.201134 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:21.201134 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:21.201134 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:21.201134 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:21.201134 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:21.201134 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:21.201134 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:21.201134 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:21.201134 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:21.201134 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:21.201134 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:21.201134 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:21.201134 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:21.202123 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:21.202123 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:21.202123 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:21.202123 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:21.202123 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:21.202123 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:21.202123 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:21.202123 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:21.202123 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:21.202123 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:21.202123 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:21.202123 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:21.202123 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:21.202123 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:21.202123 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:21.202123 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:21.202891 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:21.202891 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:21.202891 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:21.202891 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:21.202891 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:21.202891 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:21.202891 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:21.202891 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:21.202891 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:21.202891 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:21.202891 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:05:21.202891 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:05:21.202891 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 53/117] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 9 11:05:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:05:21.204735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bae178-9dfb-4fe3-98ae-e3817a9081b8 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:21.204735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bae178-9dfb-4fe3-98ae-e3817a9081b8 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:21.204999 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bae178-9dfb-4fe3-98ae-e3817a9081b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:21.228661 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-b5bae178-9dfb-4fe3-98ae-e3817a9081b8 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:21.229930 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-b5bae178-9dfb-4fe3-98ae-e3817a9081b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:21.287416 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f08e36-fd25-49b2-9f50-0f5c12a90bb6 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:21.310594 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:21.319732 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 54/118] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:21.321022 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bae178-9dfb-4fe3-98ae-e3817a9081b8 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:21.330920 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c7e99-8d91-4c54-a732-2f1db3260c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:21.332236 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c7e99-8d91-4c54-a732-2f1db3260c7d None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:21.332584 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c7e99-8d91-4c54-a732-2f1db3260c7d None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:21.332864 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c7e99-8d91-4c54-a732-2f1db3260c7d None admin] PATH_INFO: `/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:21.334058 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c7e99-8d91-4c54-a732-2f1db3260c7d None admin] RBAC: Authorizing `identity:get_project(project_id=b614dbb6ad10435abe1ffe4e9071d2e3)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:21.336056 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c7e99-8d91-4c54-a732-2f1db3260c7d None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:21.338688 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 65/119] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:05:21 2022] GET /identity/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:21.339606 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c7e99-8d91-4c54-a732-2f1db3260c7d None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:21.434053 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:21.468160 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bae178-9dfb-4fe3-98ae-e3817a9081b8 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:21.480070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c7e99-8d91-4c54-a732-2f1db3260c7d None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:21.505895 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e81b10-5547-4807-90ea-89575e60e345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:21.506673 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e81b10-5547-4807-90ea-89575e60e345 None admin] REQUEST_METHOD: `PUT` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:21.507029 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e81b10-5547-4807-90ea-89575e60e345 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:21.507477 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e81b10-5547-4807-90ea-89575e60e345 None admin] PATH_INFO: `/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3/users/ffaf170d5bc6440caacc8723c5238029/roles/cf09a959c760483db0dff049f84e5482` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:21.509744 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e81b10-5547-4807-90ea-89575e60e345 None admin] RBAC: Authorizing `identity:create_grant(project_id=b614dbb6ad10435abe1ffe4e9071d2e3, user_id=ffaf170d5bc6440caacc8723c5238029, role_id=cf09a959c760483db0dff049f84e5482)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:21.511379 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e81b10-5547-4807-90ea-89575e60e345 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:21.523116 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9224acf5-dfa7-4070-9e88-0e5886650b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:21.524026 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224acf5-dfa7-4070-9e88-0e5886650b26 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:21.524480 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224acf5-dfa7-4070-9e88-0e5886650b26 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:21.524922 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224acf5-dfa7-4070-9e88-0e5886650b26 None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:21.525797 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9224acf5-dfa7-4070-9e88-0e5886650b26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:21.526297 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9224acf5-dfa7-4070-9e88-0e5886650b26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:21.533311 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 55/120] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 9 11:05:21 2022] PUT /identity/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3/users/ffaf170d5bc6440caacc8723c5238029/roles/cf09a959c760483db0dff049f84e5482 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:05:21.533311 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691576e-c4cb-48f7-9804-e7e626469197 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:21.533311 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691576e-c4cb-48f7-9804-e7e626469197 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:21.533311 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691576e-c4cb-48f7-9804-e7e626469197 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:21.533311 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 56/121] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:21.534643 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9224acf5-dfa7-4070-9e88-0e5886650b26 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:21.537077 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691576e-c4cb-48f7-9804-e7e626469197 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:21.552064 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 66/122] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:05:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:21.553690 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896992e1-2e6c-4786-ba48-8846bc7faab0 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:21.554198 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896992e1-2e6c-4786-ba48-8846bc7faab0 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:21.554665 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896992e1-2e6c-4786-ba48-8846bc7faab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:21.585571 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-896992e1-2e6c-4786-ba48-8846bc7faab0 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:21.587140 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-896992e1-2e6c-4786-ba48-8846bc7faab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:21.616615 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:21.673979 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691576e-c4cb-48f7-9804-e7e626469197 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:21.715667 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771073e-12a3-4533-ab1a-fc10888e092b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:21.716500 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771073e-12a3-4533-ab1a-fc10888e092b None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:21.716786 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771073e-12a3-4533-ab1a-fc10888e092b None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:21.717059 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771073e-12a3-4533-ab1a-fc10888e092b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:21.717840 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771073e-12a3-4533-ab1a-fc10888e092b None admin] RBAC: Adding query filter params (role.id=47e69ff304f7450a8a1810bd5b95b1f2, scope.project.id=b614dbb6ad10435abe1ffe4e9071d2e3, user.id=f818baec5a1644659267f10e55e30941) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:21.718240 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771073e-12a3-4533-ab1a-fc10888e092b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:21.718882 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 67/123] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:21.719786 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896992e1-2e6c-4786-ba48-8846bc7faab0 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:21.726781 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771073e-12a3-4533-ab1a-fc10888e092b None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:21.738874 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 57/124] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:05:21 2022] GET /identity/v3/role_assignments?user.id=f818baec5a1644659267f10e55e30941&scope.project.id=b614dbb6ad10435abe1ffe4e9071d2e3&role.id=47e69ff304f7450a8a1810bd5b95b1f2 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:21.739819 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771073e-12a3-4533-ab1a-fc10888e092b None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:21.868969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:21.905558 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771073e-12a3-4533-ab1a-fc10888e092b None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:21.934522 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:21.948772 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f88da45-d12a-49a5-9aed-5ca1117a551b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:21.949684 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88da45-d12a-49a5-9aed-5ca1117a551b None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:21.950096 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88da45-d12a-49a5-9aed-5ca1117a551b None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:21.950764 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88da45-d12a-49a5-9aed-5ca1117a551b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:21.963280 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f88da45-d12a-49a5-9aed-5ca1117a551b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:21.974482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-5f88da45-d12a-49a5-9aed-5ca1117a551b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:05:21.974482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:21.974482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:21.974482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:21.974482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:21.974482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:21.974482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:21.974482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:21.974482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:21.974482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:21.974482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:21.974482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:21.974482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:21.974482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:21.974482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:21.974482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:21.975578 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:21.975578 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:21.975578 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:21.975578 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:21.975578 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:21.975578 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:21.975578 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:21.975578 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:21.975578 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:21.975578 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:21.975578 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:21.975578 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:21.975578 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:21.975578 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:21.975578 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:21.975578 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:21.976517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:21.976517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:21.976517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:21.976517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:21.976517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:21.976517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:21.976517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:21.976517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:21.976517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:21.976517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:21.976517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:05:21.976517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:05:21.976517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 58/125] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 9 11:05:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:05:21.981581 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f88da45-d12a-49a5-9aed-5ca1117a551b None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:22.007654 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896992e1-2e6c-4786-ba48-8846bc7faab0 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:22.074405 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c68dd-f222-4f6d-9861-9ad4a7ccad02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:22.075114 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c68dd-f222-4f6d-9861-9ad4a7ccad02 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:22.075402 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c68dd-f222-4f6d-9861-9ad4a7ccad02 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:22.075676 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c68dd-f222-4f6d-9861-9ad4a7ccad02 None admin] PATH_INFO: `/v3/users/07397da3682f4089a3c3c8d08484a85f` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:22.077237 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c68dd-f222-4f6d-9861-9ad4a7ccad02 None admin] RBAC: Authorizing `identity:get_user(user_id=07397da3682f4089a3c3c8d08484a85f)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:22.079434 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c68dd-f222-4f6d-9861-9ad4a7ccad02 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:22.085313 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 68/126] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:21 2022] GET /identity/v3/users/07397da3682f4089a3c3c8d08484a85f => generated 247 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:22.090927 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c68dd-f222-4f6d-9861-9ad4a7ccad02 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:22.249881 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f88da45-d12a-49a5-9aed-5ca1117a551b None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:22.318591 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c68dd-f222-4f6d-9861-9ad4a7ccad02 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:22.352280 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:22.363419 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b15c70-3cf0-4331-a13d-c6720914f788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:22.364239 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b15c70-3cf0-4331-a13d-c6720914f788 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:22.364619 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b15c70-3cf0-4331-a13d-c6720914f788 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:22.364996 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b15c70-3cf0-4331-a13d-c6720914f788 None admin] PATH_INFO: `/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:22.366511 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b15c70-3cf0-4331-a13d-c6720914f788 None admin] RBAC: Authorizing `identity:get_project(project_id=b614dbb6ad10435abe1ffe4e9071d2e3)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:22.368070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b15c70-3cf0-4331-a13d-c6720914f788 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:22.370430 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 69/127] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:05:22 2022] GET /identity/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3 => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:22.371465 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b15c70-3cf0-4331-a13d-c6720914f788 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:22.382027 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c4620-f31e-42a6-aa19-28fd4f072b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:22.382668 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c4620-f31e-42a6-aa19-28fd4f072b72 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:22.382962 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c4620-f31e-42a6-aa19-28fd4f072b72 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:22.383244 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c4620-f31e-42a6-aa19-28fd4f072b72 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:22.383938 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c4620-f31e-42a6-aa19-28fd4f072b72 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:22.384247 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c4620-f31e-42a6-aa19-28fd4f072b72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:22.385686 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c4620-f31e-42a6-aa19-28fd4f072b72 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:22.419851 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 59/128] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:05:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:22.420765 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c4620-f31e-42a6-aa19-28fd4f072b72 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:22.497219 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b15c70-3cf0-4331-a13d-c6720914f788 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:22.509790 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:22.544413 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048b186-13c0-4503-bbf1-aab8329523f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:22.545447 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048b186-13c0-4503-bbf1-aab8329523f4 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:22.545803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048b186-13c0-4503-bbf1-aab8329523f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:22.546150 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048b186-13c0-4503-bbf1-aab8329523f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:22.559095 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048b186-13c0-4503-bbf1-aab8329523f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:22.564647 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-8048b186-13c0-4503-bbf1-aab8329523f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:05:22.564647 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:22.564647 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:22.564647 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:22.564647 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:22.564647 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:22.564647 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:22.564647 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:22.564647 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:22.564647 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:22.564647 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:22.564647 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:22.564647 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:22.564647 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:22.564647 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:22.564647 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:22.565642 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:22.565642 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:22.565642 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:22.565642 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:22.565642 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:22.565642 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:22.565642 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:22.565642 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:22.565642 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:22.565642 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:22.565642 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:22.565642 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:22.565642 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:22.565642 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:22.565642 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:22.565642 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:22.566409 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:22.566409 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:22.566409 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:22.566409 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:22.566409 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:22.566409 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:22.566409 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:22.566409 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:22.566409 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:22.566409 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:22.566409 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:05:22.566409 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:05:22.566409 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 70/129] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:05:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:05:22.567038 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048b186-13c0-4503-bbf1-aab8329523f4 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:22.610771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c4620-f31e-42a6-aa19-28fd4f072b72 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:22.641913 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:22.688320 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048b186-13c0-4503-bbf1-aab8329523f4 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:22.712928 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a323dbe-6257-4c68-bcf4-5ebd5520c67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:22.714097 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a323dbe-6257-4c68-bcf4-5ebd5520c67b None admin] REQUEST_METHOD: `PUT` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:22.714641 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a323dbe-6257-4c68-bcf4-5ebd5520c67b None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:22.715128 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a323dbe-6257-4c68-bcf4-5ebd5520c67b None admin] PATH_INFO: `/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3/users/07397da3682f4089a3c3c8d08484a85f/roles/b02ba8c157bf46f4a75cdab917db78db` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:22.717543 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a323dbe-6257-4c68-bcf4-5ebd5520c67b None admin] RBAC: Authorizing `identity:create_grant(project_id=b614dbb6ad10435abe1ffe4e9071d2e3, user_id=07397da3682f4089a3c3c8d08484a85f, role_id=b02ba8c157bf46f4a75cdab917db78db)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:22.725304 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a323dbe-6257-4c68-bcf4-5ebd5520c67b None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:22.725587 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ddbe90-ab13-49a8-8072-0816c0f22d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:22.726151 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddbe90-ab13-49a8-8072-0816c0f22d79 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:22.726666 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddbe90-ab13-49a8-8072-0816c0f22d79 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:22.727040 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddbe90-ab13-49a8-8072-0816c0f22d79 None admin] PATH_INFO: `/v3/users/ffaf170d5bc6440caacc8723c5238029` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:22.728291 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ddbe90-ab13-49a8-8072-0816c0f22d79 None admin] RBAC: Authorizing `identity:get_user(user_id=ffaf170d5bc6440caacc8723c5238029)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:22.733299 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ddbe90-ab13-49a8-8072-0816c0f22d79 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:22.733299 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 71/130] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:22 2022] GET /identity/v3/users/ffaf170d5bc6440caacc8723c5238029 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:22.733299 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ddbe90-ab13-49a8-8072-0816c0f22d79 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:22.753589 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 60/131] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 9 11:05:22 2022] PUT /identity/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3/users/07397da3682f4089a3c3c8d08484a85f/roles/b02ba8c157bf46f4a75cdab917db78db => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:05:22.754938 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a323dbe-6257-4c68-bcf4-5ebd5520c67b None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:22.863796 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ddbe90-ab13-49a8-8072-0816c0f22d79 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:22.894632 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:22.913309 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0a69d-15ae-4fd5-9598-117ad447f90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:22.913309 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0a69d-15ae-4fd5-9598-117ad447f90a None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:22.913309 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0a69d-15ae-4fd5-9598-117ad447f90a None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:22.913309 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0a69d-15ae-4fd5-9598-117ad447f90a None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:22.913795 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0a69d-15ae-4fd5-9598-117ad447f90a None admin] RBAC: Adding query filter params (name=member) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:22.913795 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0a69d-15ae-4fd5-9598-117ad447f90a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:22.913795 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0a69d-15ae-4fd5-9598-117ad447f90a None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:22.920953 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 72/132] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 9 11:05:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:22.928324 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0a69d-15ae-4fd5-9598-117ad447f90a None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:22.963921 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a323dbe-6257-4c68-bcf4-5ebd5520c67b None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:22.984814 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:23.067481 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee6f75-cb4e-4bf2-b432-ee4fc841f21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:23.068150 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee6f75-cb4e-4bf2-b432-ee4fc841f21a None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:23.068438 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee6f75-cb4e-4bf2-b432-ee4fc841f21a None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:23.068720 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee6f75-cb4e-4bf2-b432-ee4fc841f21a None admin] PATH_INFO: `/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:23.074249 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee6f75-cb4e-4bf2-b432-ee4fc841f21a None admin] RBAC: Authorizing `identity:get_project(project_id=b614dbb6ad10435abe1ffe4e9071d2e3)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:23.075826 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee6f75-cb4e-4bf2-b432-ee4fc841f21a None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:23.078136 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 61/133] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:05:22 2022] GET /identity/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3 => generated 298 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:23.083914 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee6f75-cb4e-4bf2-b432-ee4fc841f21a None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:23.097266 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0a69d-15ae-4fd5-9598-117ad447f90a None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:23.163845 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c87566-71b4-4185-b6e0-a56eaf34a0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:23.164426 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c87566-71b4-4185-b6e0-a56eaf34a0dd None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:23.164708 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c87566-71b4-4185-b6e0-a56eaf34a0dd None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:23.164985 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c87566-71b4-4185-b6e0-a56eaf34a0dd None admin] PATH_INFO: `/v3/users/ffaf170d5bc6440caacc8723c5238029` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:23.166495 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c87566-71b4-4185-b6e0-a56eaf34a0dd None admin] RBAC: Authorizing `identity:get_user(user_id=ffaf170d5bc6440caacc8723c5238029)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:23.167795 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c87566-71b4-4185-b6e0-a56eaf34a0dd None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:23.169498 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 73/134] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:22 2022] GET /identity/v3/users/ffaf170d5bc6440caacc8723c5238029 => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:23.175959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c87566-71b4-4185-b6e0-a56eaf34a0dd None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:23.285656 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:23.310323 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee6f75-cb4e-4bf2-b432-ee4fc841f21a None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:23.369109 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c87566-71b4-4185-b6e0-a56eaf34a0dd None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:23.380128 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71294965-2f00-4c34-9e63-8ff332be827b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:23.380804 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71294965-2f00-4c34-9e63-8ff332be827b None admin] REQUEST_METHOD: `PUT` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:23.381085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71294965-2f00-4c34-9e63-8ff332be827b None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:23.381387 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71294965-2f00-4c34-9e63-8ff332be827b None admin] PATH_INFO: `/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3/users/ffaf170d5bc6440caacc8723c5238029/roles/60e15fc9c58142f9907a923f384849cc` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:23.384087 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71294965-2f00-4c34-9e63-8ff332be827b None admin] RBAC: Authorizing `identity:create_grant(project_id=b614dbb6ad10435abe1ffe4e9071d2e3, user_id=ffaf170d5bc6440caacc8723c5238029, role_id=60e15fc9c58142f9907a923f384849cc)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:23.385572 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71294965-2f00-4c34-9e63-8ff332be827b None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:23.410646 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 62/135] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 9 11:05:23 2022] PUT /identity/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3/users/ffaf170d5bc6440caacc8723c5238029/roles/60e15fc9c58142f9907a923f384849cc => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:05:23.428207 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bff32-abf8-48ac-b1d9-a10c9b02318d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:23.428869 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bff32-abf8-48ac-b1d9-a10c9b02318d None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:23.429166 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bff32-abf8-48ac-b1d9-a10c9b02318d None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:23.429550 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bff32-abf8-48ac-b1d9-a10c9b02318d None admin] PATH_INFO: `/v3/projects/95dedf4bd2a84c88ac419fdc8b12b002` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:23.431061 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02bff32-abf8-48ac-b1d9-a10c9b02318d None admin] RBAC: Authorizing `identity:get_project(project_id=95dedf4bd2a84c88ac419fdc8b12b002)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:23.432577 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02bff32-abf8-48ac-b1d9-a10c9b02318d None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:23.434264 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 74/136] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:05:23 2022] GET /identity/v3/projects/95dedf4bd2a84c88ac419fdc8b12b002 => generated 312 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:05:23.440670 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71294965-2f00-4c34-9e63-8ff332be827b None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:23.488213 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:23.605198 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71294965-2f00-4c34-9e63-8ff332be827b None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:23.659056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7f642-f31a-48f1-92bf-8eb943b95bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:23.660270 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7f642-f31a-48f1-92bf-8eb943b95bba None admin] REQUEST_METHOD: `PUT` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:23.660270 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7f642-f31a-48f1-92bf-8eb943b95bba None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:23.660270 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7f642-f31a-48f1-92bf-8eb943b95bba None admin] PATH_INFO: `/v3/projects/95dedf4bd2a84c88ac419fdc8b12b002/users/ffaf170d5bc6440caacc8723c5238029/roles/cf09a959c760483db0dff049f84e5482` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:23.662997 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7f642-f31a-48f1-92bf-8eb943b95bba None admin] RBAC: Authorizing `identity:create_grant(project_id=95dedf4bd2a84c88ac419fdc8b12b002, user_id=ffaf170d5bc6440caacc8723c5238029, role_id=cf09a959c760483db0dff049f84e5482)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:23.663835 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7f642-f31a-48f1-92bf-8eb943b95bba None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:23.683294 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 63/137] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 9 11:05:23 2022] PUT /identity/v3/projects/95dedf4bd2a84c88ac419fdc8b12b002/users/ffaf170d5bc6440caacc8723c5238029/roles/cf09a959c760483db0dff049f84e5482 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:05:24.306236 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72a946-0fa9-49f2-a344-88c8f02a14c5 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:24.306788 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72a946-0fa9-49f2-a344-88c8f02a14c5 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:24.306788 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72a946-0fa9-49f2-a344-88c8f02a14c5 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:24.308489 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 75/138] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:24.319677 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0dc19-ec2b-441d-9ba5-580e9a32dd49 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:24.320521 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0dc19-ec2b-441d-9ba5-580e9a32dd49 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:24.320998 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0dc19-ec2b-441d-9ba5-580e9a32dd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:24.342018 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-36a0dc19-ec2b-441d-9ba5-580e9a32dd49 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:24.344078 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-36a0dc19-ec2b-441d-9ba5-580e9a32dd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:24.448853 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 64/139] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:24.973030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c3165-00a7-42c7-a049-3c81c78853f4 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:24.973761 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c3165-00a7-42c7-a049-3c81c78853f4 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:24.974265 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c3165-00a7-42c7-a049-3c81c78853f4 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:24.976020 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 76/140] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:24.982014 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181cb15-b7a4-4454-b066-cc90bb3280ce None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:24.982528 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181cb15-b7a4-4454-b066-cc90bb3280ce None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:24.983127 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181cb15-b7a4-4454-b066-cc90bb3280ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:25.002937 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-2181cb15-b7a4-4454-b066-cc90bb3280ce None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:25.004437 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-2181cb15-b7a4-4454-b066-cc90bb3280ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:25.022619 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:25.030137 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c3165-00a7-42c7-a049-3c81c78853f4 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:25.124782 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 65/141] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:05:25.186736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c3165-00a7-42c7-a049-3c81c78853f4 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:25.210321 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:25.223946 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b735d-5abe-44a2-ad04-232131fe7672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:25.224518 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b735d-5abe-44a2-ad04-232131fe7672 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:25.224800 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b735d-5abe-44a2-ad04-232131fe7672 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:25.225078 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b735d-5abe-44a2-ad04-232131fe7672 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:25.226252 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b735d-5abe-44a2-ad04-232131fe7672 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:25.227708 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b735d-5abe-44a2-ad04-232131fe7672 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:25.229848 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 77/142] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:05:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:25.235326 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181cb15-b7a4-4454-b066-cc90bb3280ce None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:25.415208 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181cb15-b7a4-4454-b066-cc90bb3280ce None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:25.457688 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9418e7-faf3-4ca1-ac90-d06a64f3dcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:25.458300 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9418e7-faf3-4ca1-ac90-d06a64f3dcfa None admin] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:25.458637 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9418e7-faf3-4ca1-ac90-d06a64f3dcfa None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:25.458915 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9418e7-faf3-4ca1-ac90-d06a64f3dcfa None admin] PATH_INFO: `/v3/users` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:25.459562 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9418e7-faf3-4ca1-ac90-d06a64f3dcfa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:25.460992 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9418e7-faf3-4ca1-ac90-d06a64f3dcfa None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:25.492136 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 66/143] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 9 11:05:25 2022] POST /identity/v3/users => generated 283 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:05:25.518064 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b627e46-f00e-4e2b-aa02-f41d3b2de138 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:25.518599 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b627e46-f00e-4e2b-aa02-f41d3b2de138 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:25.518599 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b627e46-f00e-4e2b-aa02-f41d3b2de138 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:25.520088 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 78/144] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:25.527021 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ee4a1-a943-4187-8cb7-b38c7239739a None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:25.527303 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ee4a1-a943-4187-8cb7-b38c7239739a None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:25.527574 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ee4a1-a943-4187-8cb7-b38c7239739a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:25.547805 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-b47ee4a1-a943-4187-8cb7-b38c7239739a None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:25.548999 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-b47ee4a1-a943-4187-8cb7-b38c7239739a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:25.551754 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:25.594986 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b627e46-f00e-4e2b-aa02-f41d3b2de138 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:25.659798 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 67/145] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:25.783115 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b627e46-f00e-4e2b-aa02-f41d3b2de138 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:25.841015 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d4d17-596c-4896-b77a-178c11708fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:25.841689 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d4d17-596c-4896-b77a-178c11708fc8 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:25.841968 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d4d17-596c-4896-b77a-178c11708fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:25.842240 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d4d17-596c-4896-b77a-178c11708fc8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:25.857053 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d4d17-596c-4896-b77a-178c11708fc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:25.862069 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-cb2d4d17-596c-4896-b77a-178c11708fc8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:05:25.862069 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:25.862069 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:25.862069 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:25.862069 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:25.862069 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:25.862069 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:25.862069 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:25.862069 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:25.862069 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:25.862069 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:25.862069 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:25.862069 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:25.862069 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:25.862069 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:25.862069 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:25.863058 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:25.863058 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:25.863058 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:25.863058 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:25.863058 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:25.863058 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:25.863058 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:25.863058 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:25.863058 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:25.863058 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:25.863058 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:25.863058 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:25.863058 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:25.863058 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:25.863058 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:25.863058 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:25.863849 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:25.863849 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:25.863849 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:25.863849 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:25.863849 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:25.863849 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:25.863849 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:25.863849 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:25.863849 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:25.863849 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:25.863849 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:05:25.863849 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:05:25.863849 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 79/146] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:05:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:05:25.869328 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ee4a1-a943-4187-8cb7-b38c7239739a None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:26.015078 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ee4a1-a943-4187-8cb7-b38c7239739a None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:26.064111 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae319011-f67d-43db-96a2-53d087218380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:26.064655 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae319011-f67d-43db-96a2-53d087218380 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:26.064934 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae319011-f67d-43db-96a2-53d087218380 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:26.065208 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae319011-f67d-43db-96a2-53d087218380 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:26.065921 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae319011-f67d-43db-96a2-53d087218380 None admin] RBAC: Adding query filter params (name=member) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:26.066219 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae319011-f67d-43db-96a2-53d087218380 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:26.067601 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae319011-f67d-43db-96a2-53d087218380 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:26.077117 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:26.079644 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 68/147] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 9 11:05:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:26.083503 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d4d17-596c-4896-b77a-178c11708fc8 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:26.142805 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:26.200886 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d4d17-596c-4896-b77a-178c11708fc8 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:26.238180 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae319011-f67d-43db-96a2-53d087218380 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:26.248165 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066cb1c-cd5d-4421-8fcd-5f93452e59bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:26.248853 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066cb1c-cd5d-4421-8fcd-5f93452e59bc None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:26.249131 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066cb1c-cd5d-4421-8fcd-5f93452e59bc None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:26.249434 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066cb1c-cd5d-4421-8fcd-5f93452e59bc None admin] PATH_INFO: `/v3/users/ffaf170d5bc6440caacc8723c5238029` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:26.251353 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066cb1c-cd5d-4421-8fcd-5f93452e59bc None admin] RBAC: Authorizing `identity:get_user(user_id=ffaf170d5bc6440caacc8723c5238029)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:26.254505 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066cb1c-cd5d-4421-8fcd-5f93452e59bc None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:26.254676 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 80/148] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:26 2022] GET /identity/v3/users/ffaf170d5bc6440caacc8723c5238029 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:26.260763 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066cb1c-cd5d-4421-8fcd-5f93452e59bc None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:26.368908 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066cb1c-cd5d-4421-8fcd-5f93452e59bc None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:26.393102 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:26.408744 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f85f4-5050-40dc-a548-4f0908ec20c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:26.409606 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f85f4-5050-40dc-a548-4f0908ec20c3 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:26.409888 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f85f4-5050-40dc-a548-4f0908ec20c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:26.410157 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f85f4-5050-40dc-a548-4f0908ec20c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:26.483601 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae319011-f67d-43db-96a2-53d087218380 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:26.495151 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f85f4-5050-40dc-a548-4f0908ec20c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:26.496236 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f85f4-5050-40dc-a548-4f0908ec20c3 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:26.550033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a1079-0945-4e63-af36-7a7f8c109f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:26.551064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a1079-0945-4e63-af36-7a7f8c109f44 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:26.551560 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a1079-0945-4e63-af36-7a7f8c109f44 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:26.552044 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a1079-0945-4e63-af36-7a7f8c109f44 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:26.578607 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a1079-0945-4e63-af36-7a7f8c109f44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:26.584506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-ca8a1079-0945-4e63-af36-7a7f8c109f44 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:05:26.584506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:26.584506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:26.584506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:26.584506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:26.584506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:26.584506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:26.584506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:26.584506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:26.584506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:26.584506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:26.584506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:26.584506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:26.584506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:26.584506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:26.584506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:26.585383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:26.585383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:26.585383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:26.585383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:26.585383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:26.585383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:26.585383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:26.585383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:26.585383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:26.585383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:26.585383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:26.585383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:26.585383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:26.585383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:26.585383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:26.585383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:26.586149 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:26.586149 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:26.586149 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:26.586149 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:26.586149 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:26.586149 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:26.586149 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:26.586149 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:26.586149 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:26.586149 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:26.586149 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:05:26.586149 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:05:26.586149 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 69/149] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:05:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:05:26.594795 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a1079-0945-4e63-af36-7a7f8c109f44 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:26.642718 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 81/150] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:05:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 11:05:26.649276 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f85f4-5050-40dc-a548-4f0908ec20c3 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:26.690440 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:26.691916 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:26.756266 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a1079-0945-4e63-af36-7a7f8c109f44 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:26.805680 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2af5a-d114-4a31-9fc8-60cdf8fd6fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:26.806632 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2af5a-d114-4a31-9fc8-60cdf8fd6fb6 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:26.807060 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2af5a-d114-4a31-9fc8-60cdf8fd6fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:26.807341 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2af5a-d114-4a31-9fc8-60cdf8fd6fb6 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:26.808013 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2af5a-d114-4a31-9fc8-60cdf8fd6fb6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:26.808453 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2af5a-d114-4a31-9fc8-60cdf8fd6fb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:26.810042 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2af5a-d114-4a31-9fc8-60cdf8fd6fb6 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:26.818360 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f85f4-5050-40dc-a548-4f0908ec20c3 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:26.821681 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 70/151] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 9 11:05:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:26.824067 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074c77c-3627-4162-93df-1424cf814395 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:26.824350 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074c77c-3627-4162-93df-1424cf814395 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:26.824622 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074c77c-3627-4162-93df-1424cf814395 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:26.826219 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 71/152] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:26.829469 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074c77c-3627-4162-93df-1424cf814395 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:26.862111 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57059ff0-e090-46d1-877f-6dae7c1436ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:26.862879 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57059ff0-e090-46d1-877f-6dae7c1436ac None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:26.863166 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57059ff0-e090-46d1-877f-6dae7c1436ac None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:26.863439 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57059ff0-e090-46d1-877f-6dae7c1436ac None admin] PATH_INFO: `/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:26.864596 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57059ff0-e090-46d1-877f-6dae7c1436ac None admin] RBAC: Authorizing `identity:get_project(project_id=b614dbb6ad10435abe1ffe4e9071d2e3)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:26.866745 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57059ff0-e090-46d1-877f-6dae7c1436ac None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:26.869156 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 82/153] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:05:26 2022] GET /identity/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:26.870358 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd697a14-3f77-4d7a-81a8-30070ac2b3d5 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:26.870641 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd697a14-3f77-4d7a-81a8-30070ac2b3d5 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:26.870957 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd697a14-3f77-4d7a-81a8-30070ac2b3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:26.894278 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-dd697a14-3f77-4d7a-81a8-30070ac2b3d5 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:26.895562 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-dd697a14-3f77-4d7a-81a8-30070ac2b3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:26.971666 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074c77c-3627-4162-93df-1424cf814395 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:26.983638 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 83/154] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:26.985701 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd697a14-3f77-4d7a-81a8-30070ac2b3d5 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:27.004104 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:27.010329 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:27.030684 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2d739-2ee9-40b2-9643-ed2e8541b891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:27.031947 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2d739-2ee9-40b2-9643-ed2e8541b891 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:27.032229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2d739-2ee9-40b2-9643-ed2e8541b891 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:27.032501 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2d739-2ee9-40b2-9643-ed2e8541b891 None admin] PATH_INFO: `/v3/users/f818baec5a1644659267f10e55e30941` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:27.034924 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2d739-2ee9-40b2-9643-ed2e8541b891 None admin] RBAC: Authorizing `identity:get_user(user_id=f818baec5a1644659267f10e55e30941)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:27.036793 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2d739-2ee9-40b2-9643-ed2e8541b891 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:27.038879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 72/155] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:26 2022] GET /identity/v3/users/f818baec5a1644659267f10e55e30941 => generated 289 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:27.046214 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2d739-2ee9-40b2-9643-ed2e8541b891 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:27.174470 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2d739-2ee9-40b2-9643-ed2e8541b891 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:27.204193 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd697a14-3f77-4d7a-81a8-30070ac2b3d5 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:27.217317 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e421a7c-5e27-47e2-927e-fd1e6638add7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:27.218425 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e421a7c-5e27-47e2-927e-fd1e6638add7 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:27.218909 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e421a7c-5e27-47e2-927e-fd1e6638add7 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:27.220026 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e421a7c-5e27-47e2-927e-fd1e6638add7 None admin] PATH_INFO: `/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:27.221762 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e421a7c-5e27-47e2-927e-fd1e6638add7 None admin] RBAC: Authorizing `identity:get_project(project_id=b614dbb6ad10435abe1ffe4e9071d2e3)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:27.223422 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e421a7c-5e27-47e2-927e-fd1e6638add7 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:27.225768 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 73/156] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:05:27 2022] GET /identity/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:27.231235 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e421a7c-5e27-47e2-927e-fd1e6638add7 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:27.292084 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c1ad2-6833-4da5-a12d-5f0acce05447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:27.292797 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c1ad2-6833-4da5-a12d-5f0acce05447 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:27.293085 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c1ad2-6833-4da5-a12d-5f0acce05447 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:27.293381 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c1ad2-6833-4da5-a12d-5f0acce05447 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:27.294121 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c1ad2-6833-4da5-a12d-5f0acce05447 None admin] RBAC: Adding query filter params (role.id=cf09a959c760483db0dff049f84e5482, scope.project.id=b614dbb6ad10435abe1ffe4e9071d2e3, user.id=ffaf170d5bc6440caacc8723c5238029) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:27.294502 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c1ad2-6833-4da5-a12d-5f0acce05447 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:27.296543 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c1ad2-6833-4da5-a12d-5f0acce05447 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:27.303875 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:27.307744 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 84/157] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:05:26 2022] GET /identity/v3/role_assignments?user.id=ffaf170d5bc6440caacc8723c5238029&scope.project.id=b614dbb6ad10435abe1ffe4e9071d2e3&role.id=cf09a959c760483db0dff049f84e5482 => generated 608 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:27.362405 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e421a7c-5e27-47e2-927e-fd1e6638add7 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:27.411186 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010b6c3-c303-4d8c-88e8-303a584701d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:27.412303 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010b6c3-c303-4d8c-88e8-303a584701d9 None admin] REQUEST_METHOD: `PUT` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:27.412583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010b6c3-c303-4d8c-88e8-303a584701d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:27.412852 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010b6c3-c303-4d8c-88e8-303a584701d9 None admin] PATH_INFO: `/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3/users/f818baec5a1644659267f10e55e30941/roles/47e69ff304f7450a8a1810bd5b95b1f2` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:27.414996 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010b6c3-c303-4d8c-88e8-303a584701d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b614dbb6ad10435abe1ffe4e9071d2e3, user_id=f818baec5a1644659267f10e55e30941, role_id=47e69ff304f7450a8a1810bd5b95b1f2)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:27.416456 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010b6c3-c303-4d8c-88e8-303a584701d9 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:27.432970 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 74/158] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 9 11:05:27 2022] PUT /identity/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3/users/f818baec5a1644659267f10e55e30941/roles/47e69ff304f7450a8a1810bd5b95b1f2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:05:27.528141 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458f476-e39c-4743-9ce8-f21d834d5a93 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:27.528846 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458f476-e39c-4743-9ce8-f21d834d5a93 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:27.529430 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458f476-e39c-4743-9ce8-f21d834d5a93 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:27.532044 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 85/159] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:27.537715 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16167d70-62b3-4288-a877-add08ce59318 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:27.538265 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16167d70-62b3-4288-a877-add08ce59318 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:27.538265 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16167d70-62b3-4288-a877-add08ce59318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:27.564512 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-16167d70-62b3-4288-a877-add08ce59318 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:27.565893 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-16167d70-62b3-4288-a877-add08ce59318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:27.614845 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458f476-e39c-4743-9ce8-f21d834d5a93 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:27.683928 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 75/160] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:27.685136 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e304b5-360d-4c67-ac81-a376e4658763 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:27.685449 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e304b5-360d-4c67-ac81-a376e4658763 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:27.685723 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e304b5-360d-4c67-ac81-a376e4658763 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:27.687919 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 76/161] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:27.703266 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d5a48-ae98-40d7-ac07-4ef0c4ddeb39 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:27.703573 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d5a48-ae98-40d7-ac07-4ef0c4ddeb39 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:27.703830 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d5a48-ae98-40d7-ac07-4ef0c4ddeb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:27.751079 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-a17d5a48-ae98-40d7-ac07-4ef0c4ddeb39 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:27.752346 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-a17d5a48-ae98-40d7-ac07-4ef0c4ddeb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:27.784778 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:27.828893 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458f476-e39c-4743-9ce8-f21d834d5a93 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:27.870998 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:27.897835 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7c9a3-60b0-47ed-85c7-b0b85508e794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:27.898692 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7c9a3-60b0-47ed-85c7-b0b85508e794 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:27.899174 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7c9a3-60b0-47ed-85c7-b0b85508e794 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:27.899546 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7c9a3-60b0-47ed-85c7-b0b85508e794 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:27.919179 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 77/162] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:05:27.922467 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7c9a3-60b0-47ed-85c7-b0b85508e794 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:27.927842 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-14d7c9a3-60b0-47ed-85c7-b0b85508e794 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:05:27.927842 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:27.927842 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:27.927842 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:27.927842 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:27.927842 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:27.927842 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:27.927842 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:27.927842 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:27.927842 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:27.927842 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:27.927842 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:27.927842 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:27.927842 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:27.927842 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:27.927842 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:27.928703 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:27.928703 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:27.928703 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:27.928703 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:27.928703 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:27.928703 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:27.928703 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:27.928703 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:27.928703 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:27.928703 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:27.928703 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:27.928703 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:27.928703 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:27.928703 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:27.928703 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:27.928703 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:27.929885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:27.929885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:27.929885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:27.929885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:27.929885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:27.929885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:27.929885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:27.929885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:27.929885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:27.929885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:27.929885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:05:27.929885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:05:27.929885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 86/163] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 9 11:05:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:05:27.934939 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d5a48-ae98-40d7-ac07-4ef0c4ddeb39 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:28.091587 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d5a48-ae98-40d7-ac07-4ef0c4ddeb39 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:28.141559 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec522a-010f-470b-8ba2-bc51cda488c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:28.142182 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec522a-010f-470b-8ba2-bc51cda488c0 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:28.142462 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec522a-010f-470b-8ba2-bc51cda488c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:28.142736 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec522a-010f-470b-8ba2-bc51cda488c0 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:28.143408 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec522a-010f-470b-8ba2-bc51cda488c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:28.143710 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec522a-010f-470b-8ba2-bc51cda488c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:28.145096 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec522a-010f-470b-8ba2-bc51cda488c0 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:28.162232 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 78/164] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:05:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:28.168471 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7c9a3-60b0-47ed-85c7-b0b85508e794 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:28.258861 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec522a-010f-470b-8ba2-bc51cda488c0 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:28.321785 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7c9a3-60b0-47ed-85c7-b0b85508e794 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:28.363792 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:28.381890 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1341134-db71-4d04-b59d-994fc7d42f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:28.382948 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1341134-db71-4d04-b59d-994fc7d42f93 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:28.383383 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1341134-db71-4d04-b59d-994fc7d42f93 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:28.383897 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1341134-db71-4d04-b59d-994fc7d42f93 None admin] PATH_INFO: `/v3/users/07397da3682f4089a3c3c8d08484a85f` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:28.385342 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1341134-db71-4d04-b59d-994fc7d42f93 None admin] RBAC: Authorizing `identity:get_user(user_id=07397da3682f4089a3c3c8d08484a85f)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:28.387059 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1341134-db71-4d04-b59d-994fc7d42f93 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:28.389209 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 87/165] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:28 2022] GET /identity/v3/users/07397da3682f4089a3c3c8d08484a85f => generated 247 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:28.398458 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1341134-db71-4d04-b59d-994fc7d42f93 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:28.414515 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:28.507287 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec522a-010f-470b-8ba2-bc51cda488c0 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:28.591026 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02c5d7-4f6d-4d6c-8d41-fbe3bb56138e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:28.591696 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02c5d7-4f6d-4d6c-8d41-fbe3bb56138e None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:28.592498 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02c5d7-4f6d-4d6c-8d41-fbe3bb56138e None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:28.592498 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02c5d7-4f6d-4d6c-8d41-fbe3bb56138e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:28.600217 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1341134-db71-4d04-b59d-994fc7d42f93 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:28.619138 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f02c5d7-4f6d-4d6c-8d41-fbe3bb56138e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:28.624612 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-8f02c5d7-4f6d-4d6c-8d41-fbe3bb56138e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:05:28.624612 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:28.624612 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:28.624612 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:28.624612 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:28.624612 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:28.624612 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:28.624612 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:28.624612 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:28.624612 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:28.624612 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:28.624612 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:28.624612 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:28.624612 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:28.624612 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:28.624612 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:28.626270 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:28.626270 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:28.626270 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:28.626270 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:28.626270 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:28.626270 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:28.626270 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:28.626270 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:28.626270 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:28.626270 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:28.626270 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:28.626270 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:28.626270 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:28.626270 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:28.626270 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:28.626270 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:28.627514 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:28.627514 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:28.627514 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:28.627514 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:28.627514 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:28.627514 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:28.627514 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:28.627514 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:28.627514 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:28.627514 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:28.627514 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:05:28.627514 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:05:28.627514 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 79/166] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 9 11:05:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:05:28.633799 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02c5d7-4f6d-4d6c-8d41-fbe3bb56138e None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:28.675319 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f5012-4156-4d11-ae48-fe4b018ea910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:28.677330 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f5012-4156-4d11-ae48-fe4b018ea910 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:28.677763 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f5012-4156-4d11-ae48-fe4b018ea910 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:28.678206 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f5012-4156-4d11-ae48-fe4b018ea910 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:28.827984 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f5012-4156-4d11-ae48-fe4b018ea910 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:28.832331 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f5012-4156-4d11-ae48-fe4b018ea910 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:28.842664 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:28.853317 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02c5d7-4f6d-4d6c-8d41-fbe3bb56138e None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:28.853492 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:28.918895 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6144533-515d-430c-acd4-417b2ff90a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:28.920183 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6144533-515d-430c-acd4-417b2ff90a86 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:28.920667 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6144533-515d-430c-acd4-417b2ff90a86 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:28.921141 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6144533-515d-430c-acd4-417b2ff90a86 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:28.922053 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6144533-515d-430c-acd4-417b2ff90a86 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:28.922573 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6144533-515d-430c-acd4-417b2ff90a86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:28.924211 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6144533-515d-430c-acd4-417b2ff90a86 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:28.938837 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 80/167] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:05:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:05:28.940071 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6144533-515d-430c-acd4-417b2ff90a86 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:28.970271 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 88/168] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:05:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:05:28.971050 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f5012-4156-4d11-ae48-fe4b018ea910 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:29.074382 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f5012-4156-4d11-ae48-fe4b018ea910 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:29.085201 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:29.102056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6144533-515d-430c-acd4-417b2ff90a86 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:29.114156 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507cfef-bb59-471d-986c-770a69b101cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:29.114991 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507cfef-bb59-471d-986c-770a69b101cf None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:29.115427 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507cfef-bb59-471d-986c-770a69b101cf None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:29.115821 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507cfef-bb59-471d-986c-770a69b101cf None admin] PATH_INFO: `/v3/users/ffaf170d5bc6440caacc8723c5238029` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:29.117080 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507cfef-bb59-471d-986c-770a69b101cf None admin] RBAC: Authorizing `identity:get_user(user_id=ffaf170d5bc6440caacc8723c5238029)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:29.118679 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507cfef-bb59-471d-986c-770a69b101cf None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:29.120416 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 89/169] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:28 2022] GET /identity/v3/users/ffaf170d5bc6440caacc8723c5238029 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:29.121600 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507cfef-bb59-471d-986c-770a69b101cf None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:29.157416 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc90c2-8912-470e-8264-56ef0e109235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:29.158388 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc90c2-8912-470e-8264-56ef0e109235 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:29.158764 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc90c2-8912-470e-8264-56ef0e109235 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:29.159225 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc90c2-8912-470e-8264-56ef0e109235 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:29.179951 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc90c2-8912-470e-8264-56ef0e109235 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:29.190756 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-26fc90c2-8912-470e-8264-56ef0e109235 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:05:29.190756 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:29.190756 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:29.190756 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:29.190756 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:29.190756 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:29.190756 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:29.190756 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:29.190756 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:29.190756 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:29.190756 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:29.190756 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:29.190756 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:29.190756 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:29.190756 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:29.190756 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:29.191692 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:29.191692 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:29.191692 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:29.191692 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:29.191692 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:29.191692 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:29.191692 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:29.191692 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:29.191692 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:29.191692 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:29.191692 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:29.191692 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:29.191692 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:29.191692 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:29.191692 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:29.191692 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:29.197296 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:29.197296 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:29.197296 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:29.197296 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:29.197296 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:29.197296 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:29.197296 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:29.197296 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:29.197296 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:29.197296 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:29.197296 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:05:29.197296 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:05:29.197296 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 81/170] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:05:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:05:29.197296 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc90c2-8912-470e-8264-56ef0e109235 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:29.238422 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:29.260163 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507cfef-bb59-471d-986c-770a69b101cf None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:29.297680 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb43f10-cfb7-42ae-b6c4-e02f39951cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:29.298688 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb43f10-cfb7-42ae-b6c4-e02f39951cea None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:29.299180 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb43f10-cfb7-42ae-b6c4-e02f39951cea None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:29.299660 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb43f10-cfb7-42ae-b6c4-e02f39951cea None admin] PATH_INFO: `/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:29.301011 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb43f10-cfb7-42ae-b6c4-e02f39951cea None admin] RBAC: Authorizing `identity:get_project(project_id=b614dbb6ad10435abe1ffe4e9071d2e3)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:29.302691 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb43f10-cfb7-42ae-b6c4-e02f39951cea None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:29.304596 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 90/171] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:05:29 2022] GET /identity/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:29.305744 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb43f10-cfb7-42ae-b6c4-e02f39951cea None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:29.356448 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:29.362527 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc90c2-8912-470e-8264-56ef0e109235 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:29.416798 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb43f10-cfb7-42ae-b6c4-e02f39951cea None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:29.420755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e5a11-46df-4b84-b9c0-bb6e385486a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:29.421129 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e5a11-46df-4b84-b9c0-bb6e385486a1 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:29.421958 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e5a11-46df-4b84-b9c0-bb6e385486a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:29.422235 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e5a11-46df-4b84-b9c0-bb6e385486a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:29.455622 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae5fa9-5dca-4892-96b5-6e7fa4c8a0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:29.456612 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae5fa9-5dca-4892-96b5-6e7fa4c8a0df None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:29.457108 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae5fa9-5dca-4892-96b5-6e7fa4c8a0df None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:29.457641 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae5fa9-5dca-4892-96b5-6e7fa4c8a0df None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:29.458506 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae5fa9-5dca-4892-96b5-6e7fa4c8a0df None admin] RBAC: Adding query filter params (name=member) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:29.458995 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae5fa9-5dca-4892-96b5-6e7fa4c8a0df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:29.460549 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae5fa9-5dca-4892-96b5-6e7fa4c8a0df None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:29.469997 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 91/172] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 9 11:05:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:29.471264 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae5fa9-5dca-4892-96b5-6e7fa4c8a0df None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:29.533517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e5a11-46df-4b84-b9c0-bb6e385486a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:29.535075 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e5a11-46df-4b84-b9c0-bb6e385486a1 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:29.562832 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:29.656313 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 82/173] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:05:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:05:29.658013 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e5a11-46df-4b84-b9c0-bb6e385486a1 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:29.659178 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae5fa9-5dca-4892-96b5-6e7fa4c8a0df None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:29.667231 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:29.736237 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b0b44-b9d2-44f7-b985-e0939cb6ab24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:29.737230 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b0b44-b9d2-44f7-b985-e0939cb6ab24 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:29.737758 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b0b44-b9d2-44f7-b985-e0939cb6ab24 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:29.738233 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b0b44-b9d2-44f7-b985-e0939cb6ab24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:29.739167 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b0b44-b9d2-44f7-b985-e0939cb6ab24 None admin] RBAC: Adding query filter params (role.id=b02ba8c157bf46f4a75cdab917db78db, scope.project.id=b614dbb6ad10435abe1ffe4e9071d2e3, user.id=07397da3682f4089a3c3c8d08484a85f) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:29.739699 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b0b44-b9d2-44f7-b985-e0939cb6ab24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:29.745587 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b0b44-b9d2-44f7-b985-e0939cb6ab24 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:29.758157 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 92/174] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:05:29 2022] GET /identity/v3/role_assignments?user.id=07397da3682f4089a3c3c8d08484a85f&scope.project.id=b614dbb6ad10435abe1ffe4e9071d2e3&role.id=b02ba8c157bf46f4a75cdab917db78db => generated 608 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:29.759471 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b0b44-b9d2-44f7-b985-e0939cb6ab24 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:29.772139 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e5a11-46df-4b84-b9c0-bb6e385486a1 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:29.800464 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:29.817906 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c87cc-f610-4dcf-a7e9-7b6a1bfe2325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:29.820494 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c87cc-f610-4dcf-a7e9-7b6a1bfe2325 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:29.821748 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c87cc-f610-4dcf-a7e9-7b6a1bfe2325 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:29.822225 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c87cc-f610-4dcf-a7e9-7b6a1bfe2325 None admin] PATH_INFO: `/v3/users/ffaf170d5bc6440caacc8723c5238029` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:29.824704 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c87cc-f610-4dcf-a7e9-7b6a1bfe2325 None admin] RBAC: Authorizing `identity:get_user(user_id=ffaf170d5bc6440caacc8723c5238029)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:29.826682 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c87cc-f610-4dcf-a7e9-7b6a1bfe2325 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:29.831718 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 83/175] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:29 2022] GET /identity/v3/users/ffaf170d5bc6440caacc8723c5238029 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:29.836843 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c87cc-f610-4dcf-a7e9-7b6a1bfe2325 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:30.033050 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b0b44-b9d2-44f7-b985-e0939cb6ab24 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:30.045158 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c87cc-f610-4dcf-a7e9-7b6a1bfe2325 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:30.105896 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb31e38-00d4-4734-a97e-c99f80b542fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:30.106536 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb31e38-00d4-4734-a97e-c99f80b542fa None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:30.106816 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb31e38-00d4-4734-a97e-c99f80b542fa None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:30.107087 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb31e38-00d4-4734-a97e-c99f80b542fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:30.118129 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71c147-ba6e-466a-99e6-afc33b16e6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:30.118794 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71c147-ba6e-466a-99e6-afc33b16e6a2 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:30.119074 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71c147-ba6e-466a-99e6-afc33b16e6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:30.119346 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71c147-ba6e-466a-99e6-afc33b16e6a2 None admin] PATH_INFO: `/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:30.120592 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71c147-ba6e-466a-99e6-afc33b16e6a2 None admin] RBAC: Authorizing `identity:get_project(project_id=b614dbb6ad10435abe1ffe4e9071d2e3)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:30.122082 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71c147-ba6e-466a-99e6-afc33b16e6a2 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:30.124051 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 93/176] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:05:29 2022] GET /identity/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3 => generated 298 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:30.130451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71c147-ba6e-466a-99e6-afc33b16e6a2 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:30.199035 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:30.211939 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb31e38-00d4-4734-a97e-c99f80b542fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:30.214420 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb31e38-00d4-4734-a97e-c99f80b542fa None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:30.234465 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:30.295644 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71c147-ba6e-466a-99e6-afc33b16e6a2 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:30.334885 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 84/177] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:05:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:05:30.340787 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb31e38-00d4-4734-a97e-c99f80b542fa None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:30.366050 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1e63b-f6fa-41cd-b201-86b59512fdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:30.366693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1e63b-f6fa-41cd-b201-86b59512fdf2 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:30.366980 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1e63b-f6fa-41cd-b201-86b59512fdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:30.367252 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1e63b-f6fa-41cd-b201-86b59512fdf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:30.367988 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1e63b-f6fa-41cd-b201-86b59512fdf2 None admin] RBAC: Adding query filter params (role.id=60e15fc9c58142f9907a923f384849cc, scope.project.id=b614dbb6ad10435abe1ffe4e9071d2e3, user.id=ffaf170d5bc6440caacc8723c5238029) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:30.368296 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1e63b-f6fa-41cd-b201-86b59512fdf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:30.369790 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1e63b-f6fa-41cd-b201-86b59512fdf2 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:30.376484 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 94/178] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:05:30 2022] GET /identity/v3/role_assignments?user.id=ffaf170d5bc6440caacc8723c5238029&scope.project.id=b614dbb6ad10435abe1ffe4e9071d2e3&role.id=60e15fc9c58142f9907a923f384849cc => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:05:30.448527 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:30.459644 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb31e38-00d4-4734-a97e-c99f80b542fa None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:30.514586 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8330e-5ba7-4861-a30d-7ed1515c42c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:30.515899 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8330e-5ba7-4861-a30d-7ed1515c42c9 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:30.516193 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8330e-5ba7-4861-a30d-7ed1515c42c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:30.516512 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8330e-5ba7-4861-a30d-7ed1515c42c9 None admin] PATH_INFO: `/v3/projects/95dedf4bd2a84c88ac419fdc8b12b002` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:30.522236 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8330e-5ba7-4861-a30d-7ed1515c42c9 None admin] RBAC: Authorizing `identity:get_project(project_id=95dedf4bd2a84c88ac419fdc8b12b002)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:30.523803 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8330e-5ba7-4861-a30d-7ed1515c42c9 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:30.525882 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 85/179] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:05:30 2022] GET /identity/v3/projects/95dedf4bd2a84c88ac419fdc8b12b002 => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:30.532447 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8330e-5ba7-4861-a30d-7ed1515c42c9 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:30.532910 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a6149-1da8-42d4-8967-cbafb721c2f8 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:30.533196 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a6149-1da8-42d4-8967-cbafb721c2f8 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:30.533523 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a6149-1da8-42d4-8967-cbafb721c2f8 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:30.535141 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 95/180] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:30.558878 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b4d67-a74f-4749-b94d-19c51f018b17 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:30.559066 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b4d67-a74f-4749-b94d-19c51f018b17 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:30.559324 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b4d67-a74f-4749-b94d-19c51f018b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:30.606576 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-791b4d67-a74f-4749-b94d-19c51f018b17 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:30.607803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-791b4d67-a74f-4749-b94d-19c51f018b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:30.655308 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8330e-5ba7-4861-a30d-7ed1515c42c9 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:30.719433 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47776a84-745e-4999-a7f3-1b09e40e731d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:30.720184 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47776a84-745e-4999-a7f3-1b09e40e731d None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:30.720353 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47776a84-745e-4999-a7f3-1b09e40e731d None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:30.720565 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47776a84-745e-4999-a7f3-1b09e40e731d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:30.721312 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47776a84-745e-4999-a7f3-1b09e40e731d None admin] RBAC: Adding query filter params (role.id=cf09a959c760483db0dff049f84e5482, scope.project.id=95dedf4bd2a84c88ac419fdc8b12b002, user.id=ffaf170d5bc6440caacc8723c5238029) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:30.721613 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47776a84-745e-4999-a7f3-1b09e40e731d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:30.723040 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47776a84-745e-4999-a7f3-1b09e40e731d None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:30.735454 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 86/181] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:05:30 2022] GET /identity/v3/role_assignments?user.id=ffaf170d5bc6440caacc8723c5238029&scope.project.id=95dedf4bd2a84c88ac419fdc8b12b002&role.id=cf09a959c760483db0dff049f84e5482 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:30.742061 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 96/182] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:31.200967 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47776a84-745e-4999-a7f3-1b09e40e731d None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:31.239170 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:31.353751 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47776a84-745e-4999-a7f3-1b09e40e731d None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:31.403427 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3dbd80-547e-4bea-ab7a-e86f7fb04041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:31.404064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3dbd80-547e-4bea-ab7a-e86f7fb04041 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:31.404341 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3dbd80-547e-4bea-ab7a-e86f7fb04041 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:31.404610 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3dbd80-547e-4bea-ab7a-e86f7fb04041 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:31.417674 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3dbd80-547e-4bea-ab7a-e86f7fb04041 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:31.423754 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-db3dbd80-547e-4bea-ab7a-e86f7fb04041 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:05:31.423754 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:31.423754 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:31.423754 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:31.423754 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:31.423754 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:31.423754 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:31.423754 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:31.423754 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:31.423754 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:31.423754 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:31.423754 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:31.423754 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:31.423754 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:31.423754 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:31.423754 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:31.424645 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:31.424645 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:31.424645 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:31.424645 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:31.424645 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:31.424645 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:31.424645 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:31.424645 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:31.424645 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:31.424645 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:31.424645 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:31.424645 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:31.424645 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:31.424645 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:31.424645 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:31.424645 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:31.425462 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:31.425462 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:31.425462 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:31.425462 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:31.425462 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:31.425462 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:31.425462 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:31.425462 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:31.425462 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:31.425462 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:31.425462 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:05:31.425462 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:05:31.429399 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 87/183] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 9 11:05:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:05:31.431161 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b4d67-a74f-4749-b94d-19c51f018b17 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:31.464854 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:31.523783 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c955106-4644-4a62-89de-9d2c60c1a2f7 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:31.524110 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c955106-4644-4a62-89de-9d2c60c1a2f7 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:31.524327 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c955106-4644-4a62-89de-9d2c60c1a2f7 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:31.525852 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 88/184] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:05:31.526756 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff7337-6961-4e17-bdd6-519ec355149c None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:31.527034 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff7337-6961-4e17-bdd6-519ec355149c None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:31.527301 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff7337-6961-4e17-bdd6-519ec355149c None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:31.528593 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 89/185] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:31.534519 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc83cf-ecbf-4ab9-aec7-756cadf4401e None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:31.534802 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc83cf-ecbf-4ab9-aec7-756cadf4401e None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:31.535079 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc83cf-ecbf-4ab9-aec7-756cadf4401e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:31.541900 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b4d67-a74f-4749-b94d-19c51f018b17 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:31.553762 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-f6fc83cf-ecbf-4ab9-aec7-756cadf4401e None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:31.554981 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-f6fc83cf-ecbf-4ab9-aec7-756cadf4401e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:31.578835 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2e614-15c5-4a17-96f1-35f993579b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:31.579451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2e614-15c5-4a17-96f1-35f993579b2e None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:31.579896 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2e614-15c5-4a17-96f1-35f993579b2e None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:31.580172 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2e614-15c5-4a17-96f1-35f993579b2e None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:31.581252 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb2e614-15c5-4a17-96f1-35f993579b2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:31.581522 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb2e614-15c5-4a17-96f1-35f993579b2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:31.582894 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb2e614-15c5-4a17-96f1-35f993579b2e None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:31.596147 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 97/186] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:05:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:31.596147 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3257bbb-8d6c-4dd2-9b1e-e2fd1e9865a4 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:31.596391 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3257bbb-8d6c-4dd2-9b1e-e2fd1e9865a4 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:31.596803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3257bbb-8d6c-4dd2-9b1e-e2fd1e9865a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:31.614782 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-c3257bbb-8d6c-4dd2-9b1e-e2fd1e9865a4 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:31.615975 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-c3257bbb-8d6c-4dd2-9b1e-e2fd1e9865a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:31.633575 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 90/187] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:31.638192 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc83cf-ecbf-4ab9-aec7-756cadf4401e None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:31.661315 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:31.701162 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 98/188] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:31.707413 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06209194-ce61-4c78-8385-0f5bfdd0c8d6 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:31.707696 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06209194-ce61-4c78-8385-0f5bfdd0c8d6 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:31.707966 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06209194-ce61-4c78-8385-0f5bfdd0c8d6 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:31.709424 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 99/189] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:05:31.714195 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ef748-5458-4623-a232-6d927eeb244d None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:31.714481 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ef748-5458-4623-a232-6d927eeb244d None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:31.714755 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ef748-5458-4623-a232-6d927eeb244d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:31.734180 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-826ef748-5458-4623-a232-6d927eeb244d None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:31.734985 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-826ef748-5458-4623-a232-6d927eeb244d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:31.754492 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:31.768403 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc83cf-ecbf-4ab9-aec7-756cadf4401e None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:31.809896 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844b121-0ca6-4567-8341-a29095d19065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:31.810903 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844b121-0ca6-4567-8341-a29095d19065 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:31.811439 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844b121-0ca6-4567-8341-a29095d19065 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:31.811782 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844b121-0ca6-4567-8341-a29095d19065 None admin] PATH_INFO: `/v3/users/ad9264288ca34a9090df739aed381fc3` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:31.821313 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 100/190] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:31.833163 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844b121-0ca6-4567-8341-a29095d19065 None admin] RBAC: Authorizing `identity:get_user(user_id=ad9264288ca34a9090df739aed381fc3)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:31.834983 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844b121-0ca6-4567-8341-a29095d19065 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:31.841460 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 91/191] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:31 2022] GET /identity/v3/users/ad9264288ca34a9090df739aed381fc3 => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:31.845202 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ef748-5458-4623-a232-6d927eeb244d None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:31.947251 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ef748-5458-4623-a232-6d927eeb244d None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:31.960357 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844b121-0ca6-4567-8341-a29095d19065 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:31.984633 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cf6db-0f57-43c7-a5c3-04a89dddf68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:31.985170 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cf6db-0f57-43c7-a5c3-04a89dddf68c None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:31.985473 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cf6db-0f57-43c7-a5c3-04a89dddf68c None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:31.985745 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cf6db-0f57-43c7-a5c3-04a89dddf68c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:32.012972 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:32.055187 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:32.064771 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2cf6db-0f57-43c7-a5c3-04a89dddf68c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:32.066302 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2cf6db-0f57-43c7-a5c3-04a89dddf68c None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:32.092394 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844b121-0ca6-4567-8341-a29095d19065 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:32.131857 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce438b-94b8-43e1-9561-e3fdafe9a05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:32.132481 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce438b-94b8-43e1-9561-e3fdafe9a05c None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:32.132758 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce438b-94b8-43e1-9561-e3fdafe9a05c None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:32.133024 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce438b-94b8-43e1-9561-e3fdafe9a05c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:32.143679 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce438b-94b8-43e1-9561-e3fdafe9a05c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:32.148517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-73ce438b-94b8-43e1-9561-e3fdafe9a05c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:05:32.148517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:32.148517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:32.148517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:32.148517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:32.148517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:32.148517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:32.148517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:32.148517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:32.148517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:32.148517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:32.148517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:32.148517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:32.148517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:32.148517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:32.148517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:32.149448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:32.149448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:32.149448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:32.149448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:32.149448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:32.149448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:32.149448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:32.149448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:32.149448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:32.149448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:32.149448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:32.149448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:32.149448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:32.149448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:32.149448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:32.149448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:32.150245 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:32.150245 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:32.150245 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:32.150245 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:32.150245 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:32.150245 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:32.150245 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:32.150245 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:32.150245 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:32.150245 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:32.150245 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:05:32.150245 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:05:32.150245 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 92/192] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:05:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:05:32.150921 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce438b-94b8-43e1-9561-e3fdafe9a05c None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:32.176304 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 101/193] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:05:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:05:32.177141 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cf6db-0f57-43c7-a5c3-04a89dddf68c None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:32.238075 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:32.255053 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce438b-94b8-43e1-9561-e3fdafe9a05c None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:32.283420 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:32.283585 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cf6db-0f57-43c7-a5c3-04a89dddf68c None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:32.289780 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cb815-f07f-468c-aedf-7e44e1e7da86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:32.290410 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cb815-f07f-468c-aedf-7e44e1e7da86 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:32.290687 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cb815-f07f-468c-aedf-7e44e1e7da86 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:32.290953 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cb815-f07f-468c-aedf-7e44e1e7da86 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:32.301596 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0cb815-f07f-468c-aedf-7e44e1e7da86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:32.306933 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-2a0cb815-f07f-468c-aedf-7e44e1e7da86 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:05:32.306933 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:32.306933 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:32.306933 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:32.306933 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:32.306933 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:32.306933 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:32.306933 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:32.306933 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:32.306933 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:32.306933 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:32.306933 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:32.306933 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:32.306933 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:32.306933 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:32.306933 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:32.307997 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:32.307997 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:32.307997 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:32.307997 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:32.307997 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:32.307997 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:32.307997 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:32.307997 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:32.307997 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:32.307997 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:32.307997 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:32.307997 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:32.307997 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:32.307997 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:32.307997 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:32.307997 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:32.310241 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:32.310241 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:32.310241 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:32.310241 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:32.310241 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:32.310241 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:32.310241 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:32.310241 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:32.310241 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:32.310241 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:32.310241 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:05:32.310241 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:05:32.310241 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 93/194] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 9 11:05:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:05:32.310241 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cb815-f07f-468c-aedf-7e44e1e7da86 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:32.326806 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be91d55-7cd9-4e23-8d61-5d714f4e7e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:32.327987 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be91d55-7cd9-4e23-8d61-5d714f4e7e64 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:32.328268 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be91d55-7cd9-4e23-8d61-5d714f4e7e64 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:32.328539 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be91d55-7cd9-4e23-8d61-5d714f4e7e64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:32.329689 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be91d55-7cd9-4e23-8d61-5d714f4e7e64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:32.331119 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be91d55-7cd9-4e23-8d61-5d714f4e7e64 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:32.332676 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 102/195] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:05:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:32.337955 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be91d55-7cd9-4e23-8d61-5d714f4e7e64 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:32.410375 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cb815-f07f-468c-aedf-7e44e1e7da86 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:32.437799 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be91d55-7cd9-4e23-8d61-5d714f4e7e64 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:32.444148 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b284ef8-8c85-45f6-a6f5-6c36b2d7a9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:32.444759 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b284ef8-8c85-45f6-a6f5-6c36b2d7a9c2 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:32.445047 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b284ef8-8c85-45f6-a6f5-6c36b2d7a9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:32.445343 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b284ef8-8c85-45f6-a6f5-6c36b2d7a9c2 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:32.446001 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b284ef8-8c85-45f6-a6f5-6c36b2d7a9c2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:32.446305 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b284ef8-8c85-45f6-a6f5-6c36b2d7a9c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:32.447686 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b284ef8-8c85-45f6-a6f5-6c36b2d7a9c2 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:32.456130 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 94/196] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 9 11:05:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:32.456941 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b284ef8-8c85-45f6-a6f5-6c36b2d7a9c2 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:32.466769 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:32.479128 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95a1fe-af11-42b1-9ead-7e449c08c03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:32.479760 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95a1fe-af11-42b1-9ead-7e449c08c03c None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:32.480041 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95a1fe-af11-42b1-9ead-7e449c08c03c None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:32.480308 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95a1fe-af11-42b1-9ead-7e449c08c03c None admin] PATH_INFO: `/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:32.481456 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95a1fe-af11-42b1-9ead-7e449c08c03c None admin] RBAC: Authorizing `identity:get_project(project_id=73f314874b5a4cbcb9f77b3c1c53b198)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:32.482904 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95a1fe-af11-42b1-9ead-7e449c08c03c None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:32.485092 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 103/197] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:05:32 2022] GET /identity/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:32.485879 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95a1fe-af11-42b1-9ead-7e449c08c03c None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:32.515125 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:32.564039 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b284ef8-8c85-45f6-a6f5-6c36b2d7a9c2 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:32.589339 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95a1fe-af11-42b1-9ead-7e449c08c03c None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:32.596971 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b911856-1359-447e-aa2c-07508f7363fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:32.597641 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b911856-1359-447e-aa2c-07508f7363fd None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:32.597918 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b911856-1359-447e-aa2c-07508f7363fd None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:32.598189 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b911856-1359-447e-aa2c-07508f7363fd None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:32.598848 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b911856-1359-447e-aa2c-07508f7363fd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:32.599145 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b911856-1359-447e-aa2c-07508f7363fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:32.600518 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b911856-1359-447e-aa2c-07508f7363fd None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:32.608590 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 95/198] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:05:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:32.609495 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b911856-1359-447e-aa2c-07508f7363fd None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:32.629077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c21c02-cfa8-4ea5-8d2e-0750ae02a1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:32.629720 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c21c02-cfa8-4ea5-8d2e-0750ae02a1ad None admin] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:32.629998 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c21c02-cfa8-4ea5-8d2e-0750ae02a1ad None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:32.630267 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c21c02-cfa8-4ea5-8d2e-0750ae02a1ad None admin] PATH_INFO: `/v3/users` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:32.630910 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c21c02-cfa8-4ea5-8d2e-0750ae02a1ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:32.632343 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c21c02-cfa8-4ea5-8d2e-0750ae02a1ad None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:32.653110 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 104/199] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 9 11:05:32 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:05:32.658697 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c21c02-cfa8-4ea5-8d2e-0750ae02a1ad None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:32.722300 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:32.724859 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b911856-1359-447e-aa2c-07508f7363fd None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:32.743144 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:32.769264 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a1f7b-41ae-4d2f-8d08-7daa6b45de43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:32.769959 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a1f7b-41ae-4d2f-8d08-7daa6b45de43 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:32.770878 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a1f7b-41ae-4d2f-8d08-7daa6b45de43 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:32.770878 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a1f7b-41ae-4d2f-8d08-7daa6b45de43 None admin] PATH_INFO: `/v3/users/f818baec5a1644659267f10e55e30941` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:32.771945 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a1f7b-41ae-4d2f-8d08-7daa6b45de43 None admin] RBAC: Authorizing `identity:get_user(user_id=f818baec5a1644659267f10e55e30941)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:32.773362 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a1f7b-41ae-4d2f-8d08-7daa6b45de43 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:32.774994 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 96/200] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:32 2022] GET /identity/v3/users/f818baec5a1644659267f10e55e30941 => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:32.775784 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a1f7b-41ae-4d2f-8d08-7daa6b45de43 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:32.787424 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c21c02-cfa8-4ea5-8d2e-0750ae02a1ad None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:32.829984 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ca7d0-f845-49fd-8bfe-7574068c313d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:32.830647 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ca7d0-f845-49fd-8bfe-7574068c313d None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:32.830935 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ca7d0-f845-49fd-8bfe-7574068c313d None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:32.831219 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ca7d0-f845-49fd-8bfe-7574068c313d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:32.832047 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ca7d0-f845-49fd-8bfe-7574068c313d None admin] RBAC: Adding query filter params (role.id=b02ba8c157bf46f4a75cdab917db78db, scope.project.id=73f314874b5a4cbcb9f77b3c1c53b198, user.id=ad9264288ca34a9090df739aed381fc3) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:32.832261 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ca7d0-f845-49fd-8bfe-7574068c313d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:32.833797 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ca7d0-f845-49fd-8bfe-7574068c313d None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:32.840067 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 105/201] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:05:32 2022] GET /identity/v3/role_assignments?user.id=ad9264288ca34a9090df739aed381fc3&scope.project.id=73f314874b5a4cbcb9f77b3c1c53b198&role.id=b02ba8c157bf46f4a75cdab917db78db => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:32.840758 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ca7d0-f845-49fd-8bfe-7574068c313d None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:32.928965 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a1f7b-41ae-4d2f-8d08-7daa6b45de43 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:32.977124 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8fc64-9867-4118-9161-c5b5115db8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:32.977826 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8fc64-9867-4118-9161-c5b5115db8bf None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:32.978108 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8fc64-9867-4118-9161-c5b5115db8bf None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:32.978383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8fc64-9867-4118-9161-c5b5115db8bf None admin] PATH_INFO: `/v3/users/ad9264288ca34a9090df739aed381fc3` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:32.979569 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8fc64-9867-4118-9161-c5b5115db8bf None admin] RBAC: Authorizing `identity:get_user(user_id=ad9264288ca34a9090df739aed381fc3)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:32.981058 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8fc64-9867-4118-9161-c5b5115db8bf None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:32.982386 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ca7d0-f845-49fd-8bfe-7574068c313d None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:32.982892 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 97/202] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:32 2022] GET /identity/v3/users/ad9264288ca34a9090df739aed381fc3 => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:32.989052 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8fc64-9867-4118-9161-c5b5115db8bf None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:33.000824 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:33.035959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b57b70-5b34-408c-8ac0-c231f9dd7758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:33.036505 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b57b70-5b34-408c-8ac0-c231f9dd7758 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:33.036782 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b57b70-5b34-408c-8ac0-c231f9dd7758 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:33.037051 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b57b70-5b34-408c-8ac0-c231f9dd7758 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:33.075207 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:33.141338 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b57b70-5b34-408c-8ac0-c231f9dd7758 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:33.143193 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b57b70-5b34-408c-8ac0-c231f9dd7758 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:33.148103 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8fc64-9867-4118-9161-c5b5115db8bf None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:33.189249 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6862ec4-d7f4-4cd3-b66f-ffac0914e389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:33.190237 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6862ec4-d7f4-4cd3-b66f-ffac0914e389 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:33.190738 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6862ec4-d7f4-4cd3-b66f-ffac0914e389 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:33.191251 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6862ec4-d7f4-4cd3-b66f-ffac0914e389 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:33.266255 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 106/203] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:05:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:05:33.269005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b57b70-5b34-408c-8ac0-c231f9dd7758 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:33.277147 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6862ec4-d7f4-4cd3-b66f-ffac0914e389 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:33.279064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6862ec4-d7f4-4cd3-b66f-ffac0914e389 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:33.281898 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:33.359339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:33.381678 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b57b70-5b34-408c-8ac0-c231f9dd7758 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:33.422855 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c4d57-fa0b-4613-b9b2-e42768066d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:33.423502 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c4d57-fa0b-4613-b9b2-e42768066d63 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:33.423805 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c4d57-fa0b-4613-b9b2-e42768066d63 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:33.424036 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c4d57-fa0b-4613-b9b2-e42768066d63 None admin] PATH_INFO: `/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:33.425233 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c4d57-fa0b-4613-b9b2-e42768066d63 None admin] RBAC: Authorizing `identity:get_project(project_id=b614dbb6ad10435abe1ffe4e9071d2e3)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:33.426732 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c4d57-fa0b-4613-b9b2-e42768066d63 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:33.428430 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 107/204] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:05:33 2022] GET /identity/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:33.442356 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c4d57-fa0b-4613-b9b2-e42768066d63 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:33.464459 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 98/205] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:05:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 11:05:33.465838 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6862ec4-d7f4-4cd3-b66f-ffac0914e389 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:33.593088 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:33.633217 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6862ec4-d7f4-4cd3-b66f-ffac0914e389 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:33.636843 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c4d57-fa0b-4613-b9b2-e42768066d63 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:33.697643 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2b8ec-2bbe-424d-9f41-ccf9b198f9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:33.698259 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2b8ec-2bbe-424d-9f41-ccf9b198f9ee None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:33.698533 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2b8ec-2bbe-424d-9f41-ccf9b198f9ee None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:33.698798 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2b8ec-2bbe-424d-9f41-ccf9b198f9ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:33.699519 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2b8ec-2bbe-424d-9f41-ccf9b198f9ee None admin] RBAC: Adding query filter params (role.id=47e69ff304f7450a8a1810bd5b95b1f2, scope.project.id=b614dbb6ad10435abe1ffe4e9071d2e3, user.id=f818baec5a1644659267f10e55e30941) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:33.699822 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2b8ec-2bbe-424d-9f41-ccf9b198f9ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:33.701246 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2b8ec-2bbe-424d-9f41-ccf9b198f9ee None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:33.704165 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee54b90-6e70-4186-a505-284e3620278a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:33.704801 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee54b90-6e70-4186-a505-284e3620278a None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:33.705072 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee54b90-6e70-4186-a505-284e3620278a None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:33.705367 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee54b90-6e70-4186-a505-284e3620278a None admin] PATH_INFO: `/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:33.707492 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee54b90-6e70-4186-a505-284e3620278a None admin] RBAC: Authorizing `identity:get_project(project_id=73f314874b5a4cbcb9f77b3c1c53b198)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:33.708915 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee54b90-6e70-4186-a505-284e3620278a None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:33.715386 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 99/206] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:05:33 2022] GET /identity/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:33.717539 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee54b90-6e70-4186-a505-284e3620278a None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:33.720259 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 108/207] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:05:33 2022] GET /identity/v3/role_assignments?user.id=f818baec5a1644659267f10e55e30941&scope.project.id=b614dbb6ad10435abe1ffe4e9071d2e3&role.id=47e69ff304f7450a8a1810bd5b95b1f2 => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:33.740844 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:33.873684 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee54b90-6e70-4186-a505-284e3620278a None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:33.916803 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9f9e7-bf90-4989-a690-3a33f6b40e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:33.917496 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9f9e7-bf90-4989-a690-3a33f6b40e7d None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:33.917779 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9f9e7-bf90-4989-a690-3a33f6b40e7d None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:33.918050 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9f9e7-bf90-4989-a690-3a33f6b40e7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:33.918780 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9f9e7-bf90-4989-a690-3a33f6b40e7d None admin] RBAC: Adding query filter params (role.id=60e15fc9c58142f9907a923f384849cc, scope.project.id=73f314874b5a4cbcb9f77b3c1c53b198, user.id=ad9264288ca34a9090df739aed381fc3) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:33.919085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9f9e7-bf90-4989-a690-3a33f6b40e7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:33.920786 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9f9e7-bf90-4989-a690-3a33f6b40e7d None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:33.927121 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 100/208] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:05:33 2022] GET /identity/v3/role_assignments?user.id=ad9264288ca34a9090df739aed381fc3&scope.project.id=73f314874b5a4cbcb9f77b3c1c53b198&role.id=60e15fc9c58142f9907a923f384849cc => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:05:35.472185 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b5115-14b0-4caa-9092-32cd3de7d926 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:35.472729 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b5115-14b0-4caa-9092-32cd3de7d926 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:35.472729 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b5115-14b0-4caa-9092-32cd3de7d926 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:35.474065 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 109/209] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:35.479286 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044695e-c026-4a26-a639-5b8884bc4bd7 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:35.479713 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044695e-c026-4a26-a639-5b8884bc4bd7 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:35.479808 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044695e-c026-4a26-a639-5b8884bc4bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:35.498511 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-a044695e-c026-4a26-a639-5b8884bc4bd7 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:35.501534 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-a044695e-c026-4a26-a639-5b8884bc4bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:35.572162 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 101/210] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:35.603085 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c2dc3-be77-4ec7-8134-79b55ed9a4be None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:35.603424 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c2dc3-be77-4ec7-8134-79b55ed9a4be None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:35.603631 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c2dc3-be77-4ec7-8134-79b55ed9a4be None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:35.605132 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 110/211] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:35.611404 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab3342-2770-4062-a12f-a07deb0f61c1 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:35.611692 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab3342-2770-4062-a12f-a07deb0f61c1 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:35.611969 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab3342-2770-4062-a12f-a07deb0f61c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:35.631090 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-e0ab3342-2770-4062-a12f-a07deb0f61c1 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:35.632256 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-e0ab3342-2770-4062-a12f-a07deb0f61c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:35.640571 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:35.680501 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a658018-c678-4ac3-b559-8143f9ea8ab5 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:35.680826 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a658018-c678-4ac3-b559-8143f9ea8ab5 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:35.681032 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a658018-c678-4ac3-b559-8143f9ea8ab5 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:35.683158 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 111/212] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:35.692255 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bd825-1c82-46b2-be59-9d96f32fd1c6 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:35.692669 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bd825-1c82-46b2-be59-9d96f32fd1c6 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:35.693045 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bd825-1c82-46b2-be59-9d96f32fd1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:35.712344 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 102/213] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:35.725304 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-054bd825-1c82-46b2-be59-9d96f32fd1c6 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:35.725304 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-054bd825-1c82-46b2-be59-9d96f32fd1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:35.789373 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 112/214] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:35.914381 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab3342-2770-4062-a12f-a07deb0f61c1 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:36.023600 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab3342-2770-4062-a12f-a07deb0f61c1 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:36.057003 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bd825-1c82-46b2-be59-9d96f32fd1c6 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:36.065189 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572bd3d-f1a7-4f13-a25c-664164635fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:36.065909 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572bd3d-f1a7-4f13-a25c-664164635fcd None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:36.066960 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572bd3d-f1a7-4f13-a25c-664164635fcd None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:36.067230 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572bd3d-f1a7-4f13-a25c-664164635fcd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:36.083616 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572bd3d-f1a7-4f13-a25c-664164635fcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:36.090707 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-a572bd3d-f1a7-4f13-a25c-664164635fcd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:05:36.090707 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:36.090707 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:36.090707 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:36.090707 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:36.090707 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:36.090707 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:36.090707 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:36.090707 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:36.090707 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:36.090707 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:36.090707 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:36.090707 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:36.090707 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:36.090707 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:36.090707 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:36.091599 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:36.091599 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:36.091599 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:36.091599 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:36.091599 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:36.091599 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:36.091599 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:36.091599 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:36.091599 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:36.091599 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:36.091599 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:36.091599 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:36.091599 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:36.091599 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:36.091599 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:36.091599 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:36.092414 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:36.092414 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:36.092414 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:36.092414 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:36.092414 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:36.092414 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:36.092414 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:36.092414 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:36.092414 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:36.092414 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:36.092414 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:05:36.092414 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:05:36.093638 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 103/215] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 9 11:05:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:05:36.099271 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572bd3d-f1a7-4f13-a25c-664164635fcd None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:36.104453 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:36.141039 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:36.177244 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bd825-1c82-46b2-be59-9d96f32fd1c6 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:36.218937 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ec3b9-75fd-4d71-b602-c4df5ed10981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:36.219848 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ec3b9-75fd-4d71-b602-c4df5ed10981 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:36.220314 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ec3b9-75fd-4d71-b602-c4df5ed10981 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:36.220985 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ec3b9-75fd-4d71-b602-c4df5ed10981 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:36.224549 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572bd3d-f1a7-4f13-a25c-664164635fcd None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:36.235438 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ec3b9-75fd-4d71-b602-c4df5ed10981 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:36.244355 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-8c5ec3b9-75fd-4d71-b602-c4df5ed10981 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:05:36.244355 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:36.244355 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:36.244355 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:36.244355 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:36.244355 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:36.244355 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:36.244355 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:36.244355 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:36.244355 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:36.244355 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:36.244355 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:36.244355 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:36.244355 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:36.244355 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:36.244355 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:36.245562 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:36.245562 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:36.245562 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:36.245562 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:36.245562 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:36.245562 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:36.245562 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:36.245562 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:36.245562 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:36.245562 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:36.245562 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:36.245562 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:36.245562 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:36.245562 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:36.245562 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:36.245562 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:36.247273 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:36.247273 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:36.247273 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:36.247273 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:36.247273 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:36.247273 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:36.247273 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:36.247273 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:36.247273 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:36.247273 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:36.247273 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:05:36.247273 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:05:36.247273 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 113/216] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:05:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:05:36.248629 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ec3b9-75fd-4d71-b602-c4df5ed10981 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:36.274101 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce498c7-8038-44b9-a6ba-aa9c108533a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:36.274824 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce498c7-8038-44b9-a6ba-aa9c108533a4 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:36.275103 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce498c7-8038-44b9-a6ba-aa9c108533a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:36.275595 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce498c7-8038-44b9-a6ba-aa9c108533a4 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:36.276155 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce498c7-8038-44b9-a6ba-aa9c108533a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:36.276429 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce498c7-8038-44b9-a6ba-aa9c108533a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:36.277964 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce498c7-8038-44b9-a6ba-aa9c108533a4 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:36.289006 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 104/217] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:05:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:36.289006 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce498c7-8038-44b9-a6ba-aa9c108533a4 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:36.362143 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ec3b9-75fd-4d71-b602-c4df5ed10981 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:36.367462 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:36.392808 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:36.399293 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc45f5c-6e91-499f-b4e9-c86fb6b13cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:36.400216 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc45f5c-6e91-499f-b4e9-c86fb6b13cd7 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:36.400501 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc45f5c-6e91-499f-b4e9-c86fb6b13cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:36.400774 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc45f5c-6e91-499f-b4e9-c86fb6b13cd7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:36.402496 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc45f5c-6e91-499f-b4e9-c86fb6b13cd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:36.404439 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc45f5c-6e91-499f-b4e9-c86fb6b13cd7 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:36.411595 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 114/218] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:05:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:36.411595 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc45f5c-6e91-499f-b4e9-c86fb6b13cd7 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:36.411812 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce498c7-8038-44b9-a6ba-aa9c108533a4 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:36.451448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7cd1a-c4a5-4553-9e86-5e7aea57b07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:36.451975 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7cd1a-c4a5-4553-9e86-5e7aea57b07c None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:36.452274 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7cd1a-c4a5-4553-9e86-5e7aea57b07c None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:36.452545 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7cd1a-c4a5-4553-9e86-5e7aea57b07c None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:36.453324 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7cd1a-c4a5-4553-9e86-5e7aea57b07c None admin] RBAC: Adding query filter params (name=member) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:36.453805 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7cd1a-c4a5-4553-9e86-5e7aea57b07c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:36.454909 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7cd1a-c4a5-4553-9e86-5e7aea57b07c None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:36.464243 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 105/219] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 9 11:05:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:36.464906 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7cd1a-c4a5-4553-9e86-5e7aea57b07c None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:36.525130 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc45f5c-6e91-499f-b4e9-c86fb6b13cd7 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:36.564374 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfd4bc-061e-4d74-807d-63509a1c617f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:36.565008 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfd4bc-061e-4d74-807d-63509a1c617f None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:36.565310 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfd4bc-061e-4d74-807d-63509a1c617f None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:36.565570 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfd4bc-061e-4d74-807d-63509a1c617f None admin] PATH_INFO: `/v3/users/ad9264288ca34a9090df739aed381fc3` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:36.566699 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bfd4bc-061e-4d74-807d-63509a1c617f None admin] RBAC: Authorizing `identity:get_user(user_id=ad9264288ca34a9090df739aed381fc3)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:36.568138 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bfd4bc-061e-4d74-807d-63509a1c617f None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:36.569743 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 115/220] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:36 2022] GET /identity/v3/users/ad9264288ca34a9090df739aed381fc3 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:36.570497 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfd4bc-061e-4d74-807d-63509a1c617f None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:36.571252 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7cd1a-c4a5-4553-9e86-5e7aea57b07c None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:36.598515 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:36.607973 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b25e17-d3d7-4476-9e16-bab375fb5db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:36.609150 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b25e17-d3d7-4476-9e16-bab375fb5db3 None admin] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:36.609461 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b25e17-d3d7-4476-9e16-bab375fb5db3 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:36.609734 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b25e17-d3d7-4476-9e16-bab375fb5db3 None admin] PATH_INFO: `/v3/users` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:36.610385 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b25e17-d3d7-4476-9e16-bab375fb5db3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:36.611821 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b25e17-d3d7-4476-9e16-bab375fb5db3 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:36.634190 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 106/221] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 9 11:05:36 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:05:36.635497 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd86341-5199-4aa9-8eb3-12502fd6c0ef None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:36.635779 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd86341-5199-4aa9-8eb3-12502fd6c0ef None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:36.636051 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd86341-5199-4aa9-8eb3-12502fd6c0ef None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:36.641562 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 107/222] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:36.641562 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd86341-5199-4aa9-8eb3-12502fd6c0ef None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:36.643429 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:36.679945 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfd4bc-061e-4d74-807d-63509a1c617f None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:36.722096 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894cad8-4aba-4d94-97b8-6d5df7bb5f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:36.722996 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894cad8-4aba-4d94-97b8-6d5df7bb5f47 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:36.723274 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894cad8-4aba-4d94-97b8-6d5df7bb5f47 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:36.723545 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894cad8-4aba-4d94-97b8-6d5df7bb5f47 None admin] PATH_INFO: `/v3/users/237d04f85ddc4091a436e833d1d605b0` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:36.740446 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894cad8-4aba-4d94-97b8-6d5df7bb5f47 None admin] RBAC: Authorizing `identity:get_user(user_id=237d04f85ddc4091a436e833d1d605b0)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:36.742042 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894cad8-4aba-4d94-97b8-6d5df7bb5f47 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:36.745580 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 116/223] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:36 2022] GET /identity/v3/users/237d04f85ddc4091a436e833d1d605b0 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:36.746782 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260b703-2e10-46e4-b023-5089734e7320 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:36.747063 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260b703-2e10-46e4-b023-5089734e7320 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:36.747334 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260b703-2e10-46e4-b023-5089734e7320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:36.769162 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-6260b703-2e10-46e4-b023-5089734e7320 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:36.770411 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-6260b703-2e10-46e4-b023-5089734e7320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:36.772018 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd86341-5199-4aa9-8eb3-12502fd6c0ef None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:36.810268 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae26b24-9d6b-4f87-8e27-671956bb4f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:36.811250 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae26b24-9d6b-4f87-8e27-671956bb4f6d None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:36.812275 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae26b24-9d6b-4f87-8e27-671956bb4f6d None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:36.812559 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae26b24-9d6b-4f87-8e27-671956bb4f6d None admin] PATH_INFO: `/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:36.813799 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae26b24-9d6b-4f87-8e27-671956bb4f6d None admin] RBAC: Authorizing `identity:get_project(project_id=73f314874b5a4cbcb9f77b3c1c53b198)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:36.815279 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae26b24-9d6b-4f87-8e27-671956bb4f6d None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:36.821894 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 108/224] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:05:36 2022] GET /identity/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:36.823030 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae26b24-9d6b-4f87-8e27-671956bb4f6d None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:36.850034 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 117/225] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:36.850867 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260b703-2e10-46e4-b023-5089734e7320 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:36.886004 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:36.916180 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:36.961185 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae26b24-9d6b-4f87-8e27-671956bb4f6d None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:36.986820 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260b703-2e10-46e4-b023-5089734e7320 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:37.004705 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a319df-4124-4743-badb-fd28e898d740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:37.005365 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a319df-4124-4743-badb-fd28e898d740 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:37.005646 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a319df-4124-4743-badb-fd28e898d740 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:37.005915 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a319df-4124-4743-badb-fd28e898d740 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:37.029356 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2a8a6-f9c3-4872-b33c-15d030126f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:37.030029 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2a8a6-f9c3-4872-b33c-15d030126f0c None admin] REQUEST_METHOD: `PUT` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:37.030306 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2a8a6-f9c3-4872-b33c-15d030126f0c None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:37.030609 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2a8a6-f9c3-4872-b33c-15d030126f0c None admin] PATH_INFO: `/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198/users/ad9264288ca34a9090df739aed381fc3/roles/b02ba8c157bf46f4a75cdab917db78db` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:37.032766 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf2a8a6-f9c3-4872-b33c-15d030126f0c None admin] RBAC: Authorizing `identity:create_grant(project_id=73f314874b5a4cbcb9f77b3c1c53b198, user_id=ad9264288ca34a9090df739aed381fc3, role_id=b02ba8c157bf46f4a75cdab917db78db)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:37.034237 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf2a8a6-f9c3-4872-b33c-15d030126f0c None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:37.053153 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 118/226] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 9 11:05:36 2022] PUT /identity/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198/users/ad9264288ca34a9090df739aed381fc3/roles/b02ba8c157bf46f4a75cdab917db78db => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:05:37.100698 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a319df-4124-4743-badb-fd28e898d740 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:37.102303 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a319df-4124-4743-badb-fd28e898d740 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:37.166599 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:37.211915 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2a8a6-f9c3-4872-b33c-15d030126f0c None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:37.233335 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 109/227] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:05:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:05:37.240769 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a319df-4124-4743-badb-fd28e898d740 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:37.378135 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2a8a6-f9c3-4872-b33c-15d030126f0c None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:37.391696 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a319df-4124-4743-badb-fd28e898d740 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:37.400590 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:37.420387 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa4422-1d1b-4b41-b36e-852281a5bc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:37.421995 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa4422-1d1b-4b41-b36e-852281a5bc1f None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:37.422473 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa4422-1d1b-4b41-b36e-852281a5bc1f None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:37.422970 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa4422-1d1b-4b41-b36e-852281a5bc1f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:37.435420 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc4eb9-ba60-4808-9e72-1254ad7b9094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:37.435420 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc4eb9-ba60-4808-9e72-1254ad7b9094 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:37.435420 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc4eb9-ba60-4808-9e72-1254ad7b9094 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:37.435420 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc4eb9-ba60-4808-9e72-1254ad7b9094 None admin] PATH_INFO: `/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:37.436698 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc4eb9-ba60-4808-9e72-1254ad7b9094 None admin] RBAC: Authorizing `identity:get_project(project_id=73f314874b5a4cbcb9f77b3c1c53b198)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:37.438984 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc4eb9-ba60-4808-9e72-1254ad7b9094 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:37.441176 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 110/228] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:05:37 2022] GET /identity/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:37.443054 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa4422-1d1b-4b41-b36e-852281a5bc1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:37.448389 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc4eb9-ba60-4808-9e72-1254ad7b9094 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:37.449049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-22fa4422-1d1b-4b41-b36e-852281a5bc1f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:05:37.449049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:37.449049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:37.449049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:37.449049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:37.449049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:37.449049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:37.449049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:37.449049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:37.449049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:37.449049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:37.449049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:37.449049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:37.449049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:37.449049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:37.449049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:37.449959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:37.449959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:37.449959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:37.449959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:37.449959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:37.449959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:37.449959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:37.449959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:37.449959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:37.449959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:37.449959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:37.449959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:37.449959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:37.449959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:37.449959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:37.449959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:37.450738 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:37.450738 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:37.450738 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:37.450738 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:37.450738 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:37.450738 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:37.450738 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:37.450738 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:37.450738 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:37.450738 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:37.450738 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:05:37.450738 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:05:37.453162 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 119/229] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 9 11:05:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:05:37.460001 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa4422-1d1b-4b41-b36e-852281a5bc1f None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:37.497741 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:37.635347 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa4422-1d1b-4b41-b36e-852281a5bc1f None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:37.649980 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc4eb9-ba60-4808-9e72-1254ad7b9094 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:37.692893 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef1c76-1137-43cf-9ab1-cb987a13d14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:37.693545 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef1c76-1137-43cf-9ab1-cb987a13d14b None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:37.693826 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef1c76-1137-43cf-9ab1-cb987a13d14b None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:37.694098 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef1c76-1137-43cf-9ab1-cb987a13d14b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:37.694829 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef1c76-1137-43cf-9ab1-cb987a13d14b None admin] RBAC: Adding query filter params (role.id=cf09a959c760483db0dff049f84e5482, scope.project.id=73f314874b5a4cbcb9f77b3c1c53b198, user.id=237d04f85ddc4091a436e833d1d605b0) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:37.695137 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef1c76-1137-43cf-9ab1-cb987a13d14b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:37.701142 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef1c76-1137-43cf-9ab1-cb987a13d14b None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:37.710273 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a683d-1e84-4baa-bc8f-5dd9e4bf819f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:37.710893 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a683d-1e84-4baa-bc8f-5dd9e4bf819f None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:37.711175 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a683d-1e84-4baa-bc8f-5dd9e4bf819f None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:37.711446 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a683d-1e84-4baa-bc8f-5dd9e4bf819f None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:37.712117 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a683d-1e84-4baa-bc8f-5dd9e4bf819f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:37.712423 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a683d-1e84-4baa-bc8f-5dd9e4bf819f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:37.721429 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 111/230] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:05:37 2022] GET /identity/v3/role_assignments?user.id=237d04f85ddc4091a436e833d1d605b0&scope.project.id=73f314874b5a4cbcb9f77b3c1c53b198&role.id=cf09a959c760483db0dff049f84e5482 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:37.721615 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a683d-1e84-4baa-bc8f-5dd9e4bf819f None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:37.737040 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 120/231] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:05:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:37.742414 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef1c76-1137-43cf-9ab1-cb987a13d14b None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:37.858173 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:37.875225 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef1c76-1137-43cf-9ab1-cb987a13d14b None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:37.915461 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ed26a-faf3-4ce9-b02a-6cad92cd41b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:37.916110 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ed26a-faf3-4ce9-b02a-6cad92cd41b5 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:37.916390 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ed26a-faf3-4ce9-b02a-6cad92cd41b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:37.916665 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ed26a-faf3-4ce9-b02a-6cad92cd41b5 None admin] PATH_INFO: `/v3/users/ad9264288ca34a9090df739aed381fc3` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:37.917894 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ed26a-faf3-4ce9-b02a-6cad92cd41b5 None admin] RBAC: Authorizing `identity:get_user(user_id=ad9264288ca34a9090df739aed381fc3)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:37.919358 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ed26a-faf3-4ce9-b02a-6cad92cd41b5 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:37.921613 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 112/232] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:37 2022] GET /identity/v3/users/ad9264288ca34a9090df739aed381fc3 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:37.930467 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a683d-1e84-4baa-bc8f-5dd9e4bf819f None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:37.981344 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:38.053069 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a683d-1e84-4baa-bc8f-5dd9e4bf819f None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:38.090977 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95760b-4db6-45e3-b51b-67e2b1f0d229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:38.091649 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95760b-4db6-45e3-b51b-67e2b1f0d229 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:38.091933 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95760b-4db6-45e3-b51b-67e2b1f0d229 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:38.092211 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95760b-4db6-45e3-b51b-67e2b1f0d229 None admin] PATH_INFO: `/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:38.093494 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95760b-4db6-45e3-b51b-67e2b1f0d229 None admin] RBAC: Authorizing `identity:get_project(project_id=73f314874b5a4cbcb9f77b3c1c53b198)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:38.094980 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95760b-4db6-45e3-b51b-67e2b1f0d229 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:38.097021 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 121/233] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:05:37 2022] GET /identity/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:38.106485 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ed26a-faf3-4ce9-b02a-6cad92cd41b5 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:38.261734 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ed26a-faf3-4ce9-b02a-6cad92cd41b5 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:38.301089 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88513d-2c8e-40e4-944d-2a86199d3275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:38.301089 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88513d-2c8e-40e4-944d-2a86199d3275 None admin] REQUEST_METHOD: `PUT` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:38.301089 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88513d-2c8e-40e4-944d-2a86199d3275 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:38.301089 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88513d-2c8e-40e4-944d-2a86199d3275 None admin] PATH_INFO: `/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198/users/ad9264288ca34a9090df739aed381fc3/roles/60e15fc9c58142f9907a923f384849cc` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:38.302515 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88513d-2c8e-40e4-944d-2a86199d3275 None admin] RBAC: Authorizing `identity:create_grant(project_id=73f314874b5a4cbcb9f77b3c1c53b198, user_id=ad9264288ca34a9090df739aed381fc3, role_id=60e15fc9c58142f9907a923f384849cc)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:38.304143 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88513d-2c8e-40e4-944d-2a86199d3275 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:38.325221 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 113/234] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 9 11:05:38 2022] PUT /identity/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198/users/ad9264288ca34a9090df739aed381fc3/roles/60e15fc9c58142f9907a923f384849cc => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:05:39.968721 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f3a86-f55a-4abb-a56d-b0111e3024e0 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:39.969241 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f3a86-f55a-4abb-a56d-b0111e3024e0 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:39.969241 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f3a86-f55a-4abb-a56d-b0111e3024e0 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:39.970758 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 122/235] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:39.972172 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666b582-d97f-4923-bcbe-cbe726264d66 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:39.972577 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666b582-d97f-4923-bcbe-cbe726264d66 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:39.972756 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666b582-d97f-4923-bcbe-cbe726264d66 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:39.974177 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 114/236] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:39.977231 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd904288-eb00-4d66-9892-122f53621ad3 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:39.977782 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd904288-eb00-4d66-9892-122f53621ad3 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:39.978276 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd904288-eb00-4d66-9892-122f53621ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:39.979302 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed726ae-def1-431e-8393-460d886c6e8d None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:39.979589 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed726ae-def1-431e-8393-460d886c6e8d None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:39.979868 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed726ae-def1-431e-8393-460d886c6e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:39.998374 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-fd904288-eb00-4d66-9892-122f53621ad3 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:39.999969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-fd904288-eb00-4d66-9892-122f53621ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:40.008875 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-1ed726ae-def1-431e-8393-460d886c6e8d None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:40.010091 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-1ed726ae-def1-431e-8393-460d886c6e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:40.015759 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:40.115338 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 123/237] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:40.123265 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7823b9f-0c1f-4ba3-892f-7729e6ab5d37 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:40.123546 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7823b9f-0c1f-4ba3-892f-7729e6ab5d37 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:40.123821 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7823b9f-0c1f-4ba3-892f-7729e6ab5d37 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:40.127483 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 124/238] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:40.133496 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95ba3f-eb44-4cdf-a022-c4ef49e55aed None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:40.133781 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95ba3f-eb44-4cdf-a022-c4ef49e55aed None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:40.134056 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95ba3f-eb44-4cdf-a022-c4ef49e55aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:40.156048 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 115/239] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:40.167243 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-aa95ba3f-eb44-4cdf-a022-c4ef49e55aed None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:40.168445 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-aa95ba3f-eb44-4cdf-a022-c4ef49e55aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:40.210124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:40.277836 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 125/240] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:05:40.526292 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed726ae-def1-431e-8393-460d886c6e8d None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:40.679212 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed726ae-def1-431e-8393-460d886c6e8d None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:40.720785 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1151d73-1da0-4baf-b734-b035b06ba8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:40.721499 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1151d73-1da0-4baf-b734-b035b06ba8b7 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:40.721738 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1151d73-1da0-4baf-b734-b035b06ba8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:40.722008 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1151d73-1da0-4baf-b734-b035b06ba8b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:40.723142 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1151d73-1da0-4baf-b734-b035b06ba8b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:40.724593 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1151d73-1da0-4baf-b734-b035b06ba8b7 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:40.726567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 116/241] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:05:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:40.732632 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95ba3f-eb44-4cdf-a022-c4ef49e55aed None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:40.800418 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1151d73-1da0-4baf-b734-b035b06ba8b7 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:40.833677 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:40.879597 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95ba3f-eb44-4cdf-a022-c4ef49e55aed None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:40.922685 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871274e0-ba9b-4a4a-88aa-79a7cd673f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:40.923315 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871274e0-ba9b-4a4a-88aa-79a7cd673f50 None admin] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:40.923598 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871274e0-ba9b-4a4a-88aa-79a7cd673f50 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:40.923871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871274e0-ba9b-4a4a-88aa-79a7cd673f50 None admin] PATH_INFO: `/v3/users` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:40.924372 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1151d73-1da0-4baf-b734-b035b06ba8b7 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:40.924550 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871274e0-ba9b-4a4a-88aa-79a7cd673f50 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:40.926128 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871274e0-ba9b-4a4a-88aa-79a7cd673f50 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:40.953802 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 126/242] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 9 11:05:40 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:05:40.955267 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871274e0-ba9b-4a4a-88aa-79a7cd673f50 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:40.970803 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f1456-0126-4cd8-b4ae-40f266cab8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:40.971480 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f1456-0126-4cd8-b4ae-40f266cab8b6 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:40.971840 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f1456-0126-4cd8-b4ae-40f266cab8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:40.972148 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f1456-0126-4cd8-b4ae-40f266cab8b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:41.003793 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f1456-0126-4cd8-b4ae-40f266cab8b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:41.011758 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-ee9f1456-0126-4cd8-b4ae-40f266cab8b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:05:41.011758 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:41.011758 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:41.011758 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:41.011758 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:41.011758 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:41.011758 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:41.011758 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:41.011758 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:41.011758 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:41.011758 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:41.011758 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:41.011758 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:41.011758 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:41.011758 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:41.011758 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:41.012735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:41.012735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:41.012735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:41.012735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:41.012735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:41.012735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:41.012735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:41.012735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:41.012735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:41.012735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:41.012735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:41.012735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:41.012735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:41.012735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:41.012735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:41.012735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:41.013557 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:41.013557 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:41.013557 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:41.013557 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:41.013557 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:41.013557 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:41.013557 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:41.013557 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:41.013557 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:41.013557 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:41.013557 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:05:41.013557 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:05:41.013557 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 117/243] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 9 11:05:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:05:41.021318 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:41.021844 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f1456-0126-4cd8-b4ae-40f266cab8b6 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:41.143053 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:41.158447 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871274e0-ba9b-4a4a-88aa-79a7cd673f50 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:41.193130 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f1456-0126-4cd8-b4ae-40f266cab8b6 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:41.204654 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d1f9b-2d9a-4465-8017-f94f62893e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:41.205332 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d1f9b-2d9a-4465-8017-f94f62893e6f None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:41.205619 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d1f9b-2d9a-4465-8017-f94f62893e6f None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:41.205931 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d1f9b-2d9a-4465-8017-f94f62893e6f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:41.226164 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d1f9b-2d9a-4465-8017-f94f62893e6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:41.233087 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-099d1f9b-2d9a-4465-8017-f94f62893e6f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:05:41.233087 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:41.233087 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:41.233087 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:41.233087 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:41.233087 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:41.233087 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:41.233087 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:41.233087 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:41.233087 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:41.233087 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:41.233087 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:41.233087 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:41.233087 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:41.233087 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:41.233087 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:41.234132 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:41.234132 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:41.234132 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:41.234132 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:41.234132 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:41.234132 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:41.234132 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:41.234132 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:41.234132 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:41.234132 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:41.234132 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:41.234132 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:41.234132 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:41.234132 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:41.234132 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:41.234132 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:41.234935 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:41.234935 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:41.234935 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:41.234935 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:41.234935 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:41.234935 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:41.234935 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:41.234935 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:41.234935 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:41.234935 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:41.234935 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:05:41.234935 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:05:41.234935 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 127/244] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:05:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:05:41.235999 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c5359-9e5e-4658-923e-84cf64da4b5b None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:41.236305 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c5359-9e5e-4658-923e-84cf64da4b5b None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:41.236605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c5359-9e5e-4658-923e-84cf64da4b5b None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:41.238143 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 128/245] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:41.244178 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c5359-9e5e-4658-923e-84cf64da4b5b None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:41.249222 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075e528-f42e-4e15-a9dd-da1bb41dc291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:41.249868 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075e528-f42e-4e15-a9dd-da1bb41dc291 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:41.250147 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075e528-f42e-4e15-a9dd-da1bb41dc291 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:41.250416 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075e528-f42e-4e15-a9dd-da1bb41dc291 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:41.251083 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075e528-f42e-4e15-a9dd-da1bb41dc291 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:41.251384 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075e528-f42e-4e15-a9dd-da1bb41dc291 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:41.252762 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075e528-f42e-4e15-a9dd-da1bb41dc291 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:41.265308 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 118/246] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:05:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:41.266926 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cfb48-7e27-40cc-a10d-760f553ad5a5 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:41.267299 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cfb48-7e27-40cc-a10d-760f553ad5a5 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:41.267668 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cfb48-7e27-40cc-a10d-760f553ad5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:41.290844 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-f28cfb48-7e27-40cc-a10d-760f553ad5a5 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:41.293208 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-f28cfb48-7e27-40cc-a10d-760f553ad5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:41.359418 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:41.384285 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c5359-9e5e-4658-923e-84cf64da4b5b None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:41.390220 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 119/247] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:41.391359 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28cfb48-7e27-40cc-a10d-760f553ad5a5 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:41.429537 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1548e3-c07f-4468-8f18-6c87a417a822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:41.430434 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1548e3-c07f-4468-8f18-6c87a417a822 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:41.430720 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1548e3-c07f-4468-8f18-6c87a417a822 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:41.430998 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1548e3-c07f-4468-8f18-6c87a417a822 None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:41.431673 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1548e3-c07f-4468-8f18-6c87a417a822 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:41.431977 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1548e3-c07f-4468-8f18-6c87a417a822 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:41.433910 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1548e3-c07f-4468-8f18-6c87a417a822 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:41.446703 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 129/248] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 9 11:05:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:41.455127 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1548e3-c07f-4468-8f18-6c87a417a822 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:41.472750 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:41.527493 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28cfb48-7e27-40cc-a10d-760f553ad5a5 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:41.578241 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d85b1d-2ff7-4fef-9c96-945ff7e16819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:41.579133 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d85b1d-2ff7-4fef-9c96-945ff7e16819 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:41.579561 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d85b1d-2ff7-4fef-9c96-945ff7e16819 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:41.579981 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d85b1d-2ff7-4fef-9c96-945ff7e16819 None admin] PATH_INFO: `/v3/users/ad9264288ca34a9090df739aed381fc3` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:41.581323 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d85b1d-2ff7-4fef-9c96-945ff7e16819 None admin] RBAC: Authorizing `identity:get_user(user_id=ad9264288ca34a9090df739aed381fc3)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:41.582983 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d85b1d-2ff7-4fef-9c96-945ff7e16819 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:41.584767 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 120/249] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:41 2022] GET /identity/v3/users/ad9264288ca34a9090df739aed381fc3 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:41.590451 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d85b1d-2ff7-4fef-9c96-945ff7e16819 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:41.607693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1548e3-c07f-4468-8f18-6c87a417a822 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:41.662340 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d0944-2cb0-4a17-bd86-7ac70baa3dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:41.663483 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d0944-2cb0-4a17-bd86-7ac70baa3dc1 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:41.663917 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d0944-2cb0-4a17-bd86-7ac70baa3dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:41.664503 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d0944-2cb0-4a17-bd86-7ac70baa3dc1 None admin] PATH_INFO: `/v3/users/d55a6e67c75b4693b951879e31e8a2a6` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:41.684827 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d0944-2cb0-4a17-bd86-7ac70baa3dc1 None admin] RBAC: Authorizing `identity:get_user(user_id=d55a6e67c75b4693b951879e31e8a2a6)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:41.687423 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d0944-2cb0-4a17-bd86-7ac70baa3dc1 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:41.693538 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 130/250] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:41 2022] GET /identity/v3/users/d55a6e67c75b4693b951879e31e8a2a6 => generated 297 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:05:41.696805 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dd495-f43c-4c8d-a0a5-30c315d75f81 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:41.698468 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dd495-f43c-4c8d-a0a5-30c315d75f81 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:41.698898 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dd495-f43c-4c8d-a0a5-30c315d75f81 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:41.700349 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 131/251] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:41.701259 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98dd495-f43c-4c8d-a0a5-30c315d75f81 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:41.707561 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:41.742617 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d85b1d-2ff7-4fef-9c96-945ff7e16819 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:41.796198 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:41.814132 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02f422-86c5-4371-bb8d-f63f155aee1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:41.815031 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02f422-86c5-4371-bb8d-f63f155aee1f None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:41.815460 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02f422-86c5-4371-bb8d-f63f155aee1f None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:41.815952 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02f422-86c5-4371-bb8d-f63f155aee1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:41.872185 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98dd495-f43c-4c8d-a0a5-30c315d75f81 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:41.909312 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234473d7-19c0-4110-8f4f-b5066895e2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:41.909936 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234473d7-19c0-4110-8f4f-b5066895e2f6 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:41.910217 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234473d7-19c0-4110-8f4f-b5066895e2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:41.910514 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234473d7-19c0-4110-8f4f-b5066895e2f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:41.918172 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02f422-86c5-4371-bb8d-f63f155aee1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:41.920279 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02f422-86c5-4371-bb8d-f63f155aee1f None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:42.015801 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234473d7-19c0-4110-8f4f-b5066895e2f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:42.017688 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234473d7-19c0-4110-8f4f-b5066895e2f6 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:42.020281 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:42.047154 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 121/252] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:05:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:05:42.049132 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33a9c8-80ba-44af-ad3f-b9d33c43a1cf None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:42.049648 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33a9c8-80ba-44af-ad3f-b9d33c43a1cf None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:42.050150 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33a9c8-80ba-44af-ad3f-b9d33c43a1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:42.069239 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-fc33a9c8-80ba-44af-ad3f-b9d33c43a1cf None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:42.070870 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-fc33a9c8-80ba-44af-ad3f-b9d33c43a1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:42.096849 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:42.152559 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 122/253] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:42.153864 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33a9c8-80ba-44af-ad3f-b9d33c43a1cf None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:42.155972 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 132/254] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:05:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:05:42.156716 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234473d7-19c0-4110-8f4f-b5066895e2f6 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:42.277583 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234473d7-19c0-4110-8f4f-b5066895e2f6 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:42.279356 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:42.321073 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33a9c8-80ba-44af-ad3f-b9d33c43a1cf None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:42.338293 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeac716-b88c-4df5-8039-be91ba2aedcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:42.338940 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeac716-b88c-4df5-8039-be91ba2aedcd None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:42.339217 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeac716-b88c-4df5-8039-be91ba2aedcd None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:42.339615 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeac716-b88c-4df5-8039-be91ba2aedcd None admin] PATH_INFO: `/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:42.340760 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeac716-b88c-4df5-8039-be91ba2aedcd None admin] RBAC: Authorizing `identity:get_project(project_id=73f314874b5a4cbcb9f77b3c1c53b198)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:42.342448 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeac716-b88c-4df5-8039-be91ba2aedcd None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:42.344879 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 133/255] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:05:42 2022] GET /identity/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:42.345478 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeac716-b88c-4df5-8039-be91ba2aedcd None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:42.402972 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3b0b3-a18a-46db-853a-dc4ebf466d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:42.403621 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3b0b3-a18a-46db-853a-dc4ebf466d02 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:42.403899 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3b0b3-a18a-46db-853a-dc4ebf466d02 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:42.404176 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3b0b3-a18a-46db-853a-dc4ebf466d02 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:42.429726 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3b0b3-a18a-46db-853a-dc4ebf466d02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:42.434608 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-41f3b0b3-a18a-46db-853a-dc4ebf466d02 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:05:42.434608 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:42.434608 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:42.434608 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:42.434608 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:42.434608 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:42.434608 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:42.434608 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:42.434608 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:42.434608 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:42.434608 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:42.434608 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:42.434608 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:42.434608 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:42.434608 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:42.434608 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:42.435697 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:42.435697 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:42.435697 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:42.435697 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:42.435697 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:42.435697 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:42.435697 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:42.435697 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:42.435697 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:42.435697 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:42.435697 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:42.435697 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:42.435697 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:42.435697 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:42.435697 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:42.435697 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:42.437258 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:42.437258 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:42.437258 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:42.437258 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:42.437258 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:42.437258 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:42.437258 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:42.437258 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:42.437258 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:42.437258 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:42.437258 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:05:42.437258 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:05:42.437258 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 123/256] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:05:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:05:42.437258 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3b0b3-a18a-46db-853a-dc4ebf466d02 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:42.483150 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:42.538597 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeac716-b88c-4df5-8039-be91ba2aedcd None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:42.615844 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813eb39-4aa1-4ef6-ae61-344d8bd3fec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:42.617258 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813eb39-4aa1-4ef6-ae61-344d8bd3fec1 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:42.617709 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813eb39-4aa1-4ef6-ae61-344d8bd3fec1 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:42.618134 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813eb39-4aa1-4ef6-ae61-344d8bd3fec1 None admin] PATH_INFO: `/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:42.619579 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813eb39-4aa1-4ef6-ae61-344d8bd3fec1 None admin] RBAC: Authorizing `identity:get_project(project_id=73f314874b5a4cbcb9f77b3c1c53b198)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:42.621270 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813eb39-4aa1-4ef6-ae61-344d8bd3fec1 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:42.623229 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 134/257] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:05:42 2022] GET /identity/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198 => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:42.623343 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3b0b3-a18a-46db-853a-dc4ebf466d02 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:42.625067 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813eb39-4aa1-4ef6-ae61-344d8bd3fec1 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:42.667141 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4dd9b-34b4-4ff2-9b8e-12516878e988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:42.668203 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4dd9b-34b4-4ff2-9b8e-12516878e988 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:42.668699 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4dd9b-34b4-4ff2-9b8e-12516878e988 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:42.669173 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4dd9b-34b4-4ff2-9b8e-12516878e988 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:42.670384 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4dd9b-34b4-4ff2-9b8e-12516878e988 None admin] RBAC: Adding query filter params (role.id=b02ba8c157bf46f4a75cdab917db78db, scope.project.id=73f314874b5a4cbcb9f77b3c1c53b198, user.id=ad9264288ca34a9090df739aed381fc3) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:42.670980 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4dd9b-34b4-4ff2-9b8e-12516878e988 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:42.672689 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4dd9b-34b4-4ff2-9b8e-12516878e988 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:42.678250 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:42.680502 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 124/258] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:05:42 2022] GET /identity/v3/role_assignments?user.id=ad9264288ca34a9090df739aed381fc3&scope.project.id=73f314874b5a4cbcb9f77b3c1c53b198&role.id=b02ba8c157bf46f4a75cdab917db78db => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:42.681971 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4dd9b-34b4-4ff2-9b8e-12516878e988 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:42.769256 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813eb39-4aa1-4ef6-ae61-344d8bd3fec1 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:42.823734 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a1c74-9f2b-463d-804b-5f88aa9cb1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:42.824740 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a1c74-9f2b-463d-804b-5f88aa9cb1e4 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:42.825230 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a1c74-9f2b-463d-804b-5f88aa9cb1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:42.825751 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a1c74-9f2b-463d-804b-5f88aa9cb1e4 None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:42.826379 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:42.828994 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a1c74-9f2b-463d-804b-5f88aa9cb1e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:42.830711 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a1c74-9f2b-463d-804b-5f88aa9cb1e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:42.834475 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a1c74-9f2b-463d-804b-5f88aa9cb1e4 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:42.855469 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 135/259] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 9 11:05:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:42.862405 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a1c74-9f2b-463d-804b-5f88aa9cb1e4 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:42.885045 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4dd9b-34b4-4ff2-9b8e-12516878e988 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:42.955439 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1869b-5667-435d-83ea-a5d428d4f641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:42.956107 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1869b-5667-435d-83ea-a5d428d4f641 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:42.956388 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1869b-5667-435d-83ea-a5d428d4f641 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:42.956659 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1869b-5667-435d-83ea-a5d428d4f641 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:42.970045 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1869b-5667-435d-83ea-a5d428d4f641 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:42.975761 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-04f1869b-5667-435d-83ea-a5d428d4f641 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:05:42.975761 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:42.975761 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:42.975761 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:42.975761 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:42.975761 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:42.975761 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:42.975761 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:42.975761 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:42.975761 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:42.975761 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:42.975761 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:42.975761 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:42.975761 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:42.975761 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:42.975761 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:42.976648 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:42.976648 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:42.976648 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:42.976648 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:42.976648 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:42.976648 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:42.976648 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:42.976648 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:42.976648 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:42.976648 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:42.976648 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:42.976648 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:42.976648 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:42.976648 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:42.976648 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:42.976648 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:42.978131 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:42.978131 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:42.978131 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:42.978131 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:42.978131 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:42.978131 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:42.978131 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:42.978131 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:42.978131 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:42.978131 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:42.978131 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:05:42.978131 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:05:42.978131 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 125/260] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 9 11:05:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:05:42.978131 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1869b-5667-435d-83ea-a5d428d4f641 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:42.997457 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:43.002836 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a1c74-9f2b-463d-804b-5f88aa9cb1e4 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:43.048495 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a67fa-de4f-4457-b424-484977ffc872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:43.049139 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a67fa-de4f-4457-b424-484977ffc872 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:43.049452 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a67fa-de4f-4457-b424-484977ffc872 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:43.049728 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a67fa-de4f-4457-b424-484977ffc872 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:43.050459 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a67fa-de4f-4457-b424-484977ffc872 None admin] RBAC: Adding query filter params (role.id=47e69ff304f7450a8a1810bd5b95b1f2, scope.project.id=73f314874b5a4cbcb9f77b3c1c53b198, user.id=d55a6e67c75b4693b951879e31e8a2a6) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:43.050785 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a67fa-de4f-4457-b424-484977ffc872 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:43.052201 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a67fa-de4f-4457-b424-484977ffc872 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:43.060215 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 136/261] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:05:42 2022] GET /identity/v3/role_assignments?user.id=d55a6e67c75b4693b951879e31e8a2a6&scope.project.id=73f314874b5a4cbcb9f77b3c1c53b198&role.id=47e69ff304f7450a8a1810bd5b95b1f2 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:43.061106 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a67fa-de4f-4457-b424-484977ffc872 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:43.118800 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1869b-5667-435d-83ea-a5d428d4f641 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:43.184166 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f921a-1e08-4f70-9fd8-88736d92bdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:43.184528 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a67fa-de4f-4457-b424-484977ffc872 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:43.185763 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f921a-1e08-4f70-9fd8-88736d92bdf1 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:43.186310 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f921a-1e08-4f70-9fd8-88736d92bdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:43.187363 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f921a-1e08-4f70-9fd8-88736d92bdf1 None admin] PATH_INFO: `/v3/users/237d04f85ddc4091a436e833d1d605b0` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:43.193539 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f921a-1e08-4f70-9fd8-88736d92bdf1 None admin] RBAC: Authorizing `identity:get_user(user_id=237d04f85ddc4091a436e833d1d605b0)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:43.195601 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f921a-1e08-4f70-9fd8-88736d92bdf1 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:43.197699 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 126/262] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:42 2022] GET /identity/v3/users/237d04f85ddc4091a436e833d1d605b0 => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:43.204098 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f921a-1e08-4f70-9fd8-88736d92bdf1 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:43.225379 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:43.229393 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb97e9d-4540-4fa2-ba92-7195f82aa284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:43.230028 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb97e9d-4540-4fa2-ba92-7195f82aa284 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:43.230312 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb97e9d-4540-4fa2-ba92-7195f82aa284 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:43.230584 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb97e9d-4540-4fa2-ba92-7195f82aa284 None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:43.231261 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb97e9d-4540-4fa2-ba92-7195f82aa284 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:43.231562 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb97e9d-4540-4fa2-ba92-7195f82aa284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:43.233320 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb97e9d-4540-4fa2-ba92-7195f82aa284 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:43.242765 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 137/263] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:05:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:43.254441 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb97e9d-4540-4fa2-ba92-7195f82aa284 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:43.309669 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:43.422494 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f921a-1e08-4f70-9fd8-88736d92bdf1 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:43.424767 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb97e9d-4540-4fa2-ba92-7195f82aa284 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:43.482297 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac749bb-86e7-40e4-acc3-66f54fe5555d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:43.483851 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac749bb-86e7-40e4-acc3-66f54fe5555d None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:43.485347 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac749bb-86e7-40e4-acc3-66f54fe5555d None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:43.485853 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac749bb-86e7-40e4-acc3-66f54fe5555d None admin] PATH_INFO: `/v3/users/ad9264288ca34a9090df739aed381fc3` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:43.487934 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac749bb-86e7-40e4-acc3-66f54fe5555d None admin] RBAC: Authorizing `identity:get_user(user_id=ad9264288ca34a9090df739aed381fc3)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:43.489294 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f26b5-c7ce-4b73-a6b2-32f4a40bb042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:43.491022 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac749bb-86e7-40e4-acc3-66f54fe5555d None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:43.491873 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f26b5-c7ce-4b73-a6b2-32f4a40bb042 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:43.492388 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f26b5-c7ce-4b73-a6b2-32f4a40bb042 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:43.492857 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f26b5-c7ce-4b73-a6b2-32f4a40bb042 None admin] PATH_INFO: `/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:43.494747 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 138/264] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:43 2022] GET /identity/v3/users/ad9264288ca34a9090df739aed381fc3 => generated 283 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:43.496231 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f26b5-c7ce-4b73-a6b2-32f4a40bb042 None admin] RBAC: Authorizing `identity:get_project(project_id=73f314874b5a4cbcb9f77b3c1c53b198)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:43.502195 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f26b5-c7ce-4b73-a6b2-32f4a40bb042 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:43.504468 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 127/265] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:05:43 2022] GET /identity/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198 => generated 302 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:05:43.510309 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac749bb-86e7-40e4-acc3-66f54fe5555d None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:43.511466 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f26b5-c7ce-4b73-a6b2-32f4a40bb042 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:43.645660 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:43.686721 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f26b5-c7ce-4b73-a6b2-32f4a40bb042 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:43.696611 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:43.705059 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac749bb-86e7-40e4-acc3-66f54fe5555d None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:43.741927 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d739fa4-b2ad-46c4-ac88-057b26756518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:43.742947 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d739fa4-b2ad-46c4-ac88-057b26756518 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:43.743453 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d739fa4-b2ad-46c4-ac88-057b26756518 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:43.743922 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d739fa4-b2ad-46c4-ac88-057b26756518 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:43.770019 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66842e1-0f52-45ae-b3c0-ef2496e822ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:43.771052 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66842e1-0f52-45ae-b3c0-ef2496e822ed None admin] REQUEST_METHOD: `PUT` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:43.771523 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66842e1-0f52-45ae-b3c0-ef2496e822ed None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:43.772010 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66842e1-0f52-45ae-b3c0-ef2496e822ed None admin] PATH_INFO: `/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198/users/237d04f85ddc4091a436e833d1d605b0/roles/cf09a959c760483db0dff049f84e5482` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:43.775214 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66842e1-0f52-45ae-b3c0-ef2496e822ed None admin] RBAC: Authorizing `identity:create_grant(project_id=73f314874b5a4cbcb9f77b3c1c53b198, user_id=237d04f85ddc4091a436e833d1d605b0, role_id=cf09a959c760483db0dff049f84e5482)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:43.776901 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66842e1-0f52-45ae-b3c0-ef2496e822ed None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:43.803321 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 139/266] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 9 11:05:43 2022] PUT /identity/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198/users/237d04f85ddc4091a436e833d1d605b0/roles/cf09a959c760483db0dff049f84e5482 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:05:43.856402 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d739fa4-b2ad-46c4-ac88-057b26756518 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:43.858399 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d739fa4-b2ad-46c4-ac88-057b26756518 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:43.945772 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:43.971229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 128/267] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:05:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 11:05:43.977246 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66842e1-0f52-45ae-b3c0-ef2496e822ed None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:44.116561 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66842e1-0f52-45ae-b3c0-ef2496e822ed None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:44.161166 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515483b-c525-4766-833e-a235e402870a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:44.162204 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515483b-c525-4766-833e-a235e402870a None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:44.162676 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515483b-c525-4766-833e-a235e402870a None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:44.163139 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515483b-c525-4766-833e-a235e402870a None admin] PATH_INFO: `/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:44.164511 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515483b-c525-4766-833e-a235e402870a None admin] RBAC: Authorizing `identity:get_project(project_id=73f314874b5a4cbcb9f77b3c1c53b198)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:44.166178 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515483b-c525-4766-833e-a235e402870a None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:44.167999 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 140/268] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:05:43 2022] GET /identity/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:44.174878 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d739fa4-b2ad-46c4-ac88-057b26756518 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:44.187878 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1907b7-dc5d-45f1-818a-99cabca5129e None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:44.191163 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1907b7-dc5d-45f1-818a-99cabca5129e None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:44.191801 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1907b7-dc5d-45f1-818a-99cabca5129e None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:44.194797 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 141/269] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:44.200608 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742e779-5eb9-4f2b-8958-91b538c5149a None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:44.200968 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742e779-5eb9-4f2b-8958-91b538c5149a None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:44.201492 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742e779-5eb9-4f2b-8958-91b538c5149a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:44.246198 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-f742e779-5eb9-4f2b-8958-91b538c5149a None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:44.251104 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-f742e779-5eb9-4f2b-8958-91b538c5149a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:44.286320 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:44.336604 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d739fa4-b2ad-46c4-ac88-057b26756518 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:44.370126 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 142/270] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:05:44.372127 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead62ecb-ca76-42af-b85d-ab739977e7ae None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:44.372413 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead62ecb-ca76-42af-b85d-ab739977e7ae None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:44.372690 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead62ecb-ca76-42af-b85d-ab739977e7ae None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:44.375648 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78521e0d-d876-4224-8854-fa32ebf2e484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:44.376260 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78521e0d-d876-4224-8854-fa32ebf2e484 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:44.376533 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78521e0d-d876-4224-8854-fa32ebf2e484 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:44.376799 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78521e0d-d876-4224-8854-fa32ebf2e484 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:44.377412 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 143/271] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:44.377624 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78521e0d-d876-4224-8854-fa32ebf2e484 None admin] RBAC: Adding query filter params (role.id=60e15fc9c58142f9907a923f384849cc, scope.project.id=73f314874b5a4cbcb9f77b3c1c53b198, user.id=ad9264288ca34a9090df739aed381fc3) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:44.377842 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78521e0d-d876-4224-8854-fa32ebf2e484 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:44.379588 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78521e0d-d876-4224-8854-fa32ebf2e484 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:44.379700 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9cdff-2345-4979-9bb5-ca6629a7b97c None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:44.379936 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9cdff-2345-4979-9bb5-ca6629a7b97c None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:44.380208 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9cdff-2345-4979-9bb5-ca6629a7b97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:44.392700 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 129/272] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:05:44 2022] GET /identity/v3/role_assignments?user.id=ad9264288ca34a9090df739aed381fc3&scope.project.id=73f314874b5a4cbcb9f77b3c1c53b198&role.id=60e15fc9c58142f9907a923f384849cc => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:44.408135 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-2ca9cdff-2345-4979-9bb5-ca6629a7b97c None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:44.409449 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-2ca9cdff-2345-4979-9bb5-ca6629a7b97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:44.489527 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 144/273] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:05:44.748359 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78521e0d-d876-4224-8854-fa32ebf2e484 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:44.800626 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:44.847943 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9cdff-2345-4979-9bb5-ca6629a7b97c None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:44.865710 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78521e0d-d876-4224-8854-fa32ebf2e484 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:44.908067 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fcdb7-e7f9-4064-8bf0-b6a829228c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:44.908700 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fcdb7-e7f9-4064-8bf0-b6a829228c40 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:44.908976 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fcdb7-e7f9-4064-8bf0-b6a829228c40 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:44.909243 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fcdb7-e7f9-4064-8bf0-b6a829228c40 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:44.921394 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fcdb7-e7f9-4064-8bf0-b6a829228c40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:44.927197 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-9e0fcdb7-e7f9-4064-8bf0-b6a829228c40 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:05:44.927197 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:44.927197 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:44.927197 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:44.927197 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:44.927197 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:44.927197 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:44.927197 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:44.927197 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:44.927197 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:44.927197 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:44.927197 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:44.927197 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:44.927197 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:44.927197 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:44.927197 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:44.928076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:44.928076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:44.928076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:44.928076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:44.928076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:44.928076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:44.928076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:44.928076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:44.928076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:44.928076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:44.928076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:44.928076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:44.928076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:44.928076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:44.928076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:44.928076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:44.928865 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:44.928865 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:44.928865 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:44.928865 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:44.928865 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:44.928865 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:44.928865 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:44.928865 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:44.928865 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:44.928865 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:44.928865 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:05:44.928865 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:05:44.928865 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 130/274] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:05:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:05:44.938141 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fcdb7-e7f9-4064-8bf0-b6a829228c40 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:44.949529 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:44.976403 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9cdff-2345-4979-9bb5-ca6629a7b97c None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:45.018670 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf36282-3bd9-40bc-b932-ba979454b7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:45.019432 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf36282-3bd9-40bc-b932-ba979454b7f8 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:45.019712 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf36282-3bd9-40bc-b932-ba979454b7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:45.020019 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf36282-3bd9-40bc-b932-ba979454b7f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:45.022003 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf36282-3bd9-40bc-b932-ba979454b7f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:45.023688 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf36282-3bd9-40bc-b932-ba979454b7f8 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:45.025677 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 145/275] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:05:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:05:45.033765 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf36282-3bd9-40bc-b932-ba979454b7f8 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:45.066199 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fcdb7-e7f9-4064-8bf0-b6a829228c40 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:45.068313 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:45.119885 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58266d3-80f4-4cb1-9b14-f6bf28e629b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:45.120509 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58266d3-80f4-4cb1-9b14-f6bf28e629b2 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:45.121055 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58266d3-80f4-4cb1-9b14-f6bf28e629b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:45.121364 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58266d3-80f4-4cb1-9b14-f6bf28e629b2 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:45.122043 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58266d3-80f4-4cb1-9b14-f6bf28e629b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:45.122651 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58266d3-80f4-4cb1-9b14-f6bf28e629b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:45.125656 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58266d3-80f4-4cb1-9b14-f6bf28e629b2 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:45.137145 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 131/276] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 9 11:05:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:45.147304 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58266d3-80f4-4cb1-9b14-f6bf28e629b2 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:45.157594 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf36282-3bd9-40bc-b932-ba979454b7f8 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:45.192668 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88492b38-e7dd-434e-aabe-cc28552d7165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:45.193313 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88492b38-e7dd-434e-aabe-cc28552d7165 None admin] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:45.193394 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88492b38-e7dd-434e-aabe-cc28552d7165 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:45.193760 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88492b38-e7dd-434e-aabe-cc28552d7165 None admin] PATH_INFO: `/v3/users` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:45.194271 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88492b38-e7dd-434e-aabe-cc28552d7165 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:45.195837 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88492b38-e7dd-434e-aabe-cc28552d7165 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:45.221970 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 146/277] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 9 11:05:45 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:05:45.281230 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58266d3-80f4-4cb1-9b14-f6bf28e629b2 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:45.334318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b91dd-2e9e-43a1-bba0-b029d7778c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:45.335015 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b91dd-2e9e-43a1-bba0-b029d7778c4c None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:45.335303 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b91dd-2e9e-43a1-bba0-b029d7778c4c None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:45.335641 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b91dd-2e9e-43a1-bba0-b029d7778c4c None admin] PATH_INFO: `/v3/users/87e74acd32d341af8f17482f0b1a90de` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:45.353622 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b91dd-2e9e-43a1-bba0-b029d7778c4c None admin] RBAC: Authorizing `identity:get_user(user_id=87e74acd32d341af8f17482f0b1a90de)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:45.355239 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b91dd-2e9e-43a1-bba0-b029d7778c4c None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:45.357450 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 132/278] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:45 2022] GET /identity/v3/users/87e74acd32d341af8f17482f0b1a90de => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:45.364125 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88492b38-e7dd-434e-aabe-cc28552d7165 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:45.376213 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:45.491702 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88492b38-e7dd-434e-aabe-cc28552d7165 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:45.529860 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367ae1b-7f0a-4883-9f33-0be8aaa32869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:45.531462 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367ae1b-7f0a-4883-9f33-0be8aaa32869 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:45.531925 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367ae1b-7f0a-4883-9f33-0be8aaa32869 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:45.532372 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367ae1b-7f0a-4883-9f33-0be8aaa32869 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:45.533432 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367ae1b-7f0a-4883-9f33-0be8aaa32869 None admin] RBAC: Adding query filter params (role.id=cf09a959c760483db0dff049f84e5482, user.id=87e74acd32d341af8f17482f0b1a90de, scope.system=all) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:45.533954 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367ae1b-7f0a-4883-9f33-0be8aaa32869 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:45.535476 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367ae1b-7f0a-4883-9f33-0be8aaa32869 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:45.541472 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 147/279] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Sep 9 11:05:45 2022] GET /identity/v3/role_assignments?user.id=87e74acd32d341af8f17482f0b1a90de&scope.system=all&role.id=cf09a959c760483db0dff049f84e5482 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:45.909497 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec093b-eabf-4752-87a2-d148c5d4e3ca None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:45.909979 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec093b-eabf-4752-87a2-d148c5d4e3ca None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:45.910263 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec093b-eabf-4752-87a2-d148c5d4e3ca None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:45.911920 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 133/280] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:45.917495 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146691fc-aa93-4d94-9d7c-ab7b7a7dbc42 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:45.917751 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146691fc-aa93-4d94-9d7c-ab7b7a7dbc42 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:45.918034 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146691fc-aa93-4d94-9d7c-ab7b7a7dbc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:45.945864 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-146691fc-aa93-4d94-9d7c-ab7b7a7dbc42 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:45.947083 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-146691fc-aa93-4d94-9d7c-ab7b7a7dbc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:46.038174 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:46.049738 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 148/281] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:46.451640 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec093b-eabf-4752-87a2-d148c5d4e3ca None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:46.485454 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:46.594070 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec093b-eabf-4752-87a2-d148c5d4e3ca None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:46.635849 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ab236-ebb7-4242-9597-6effa21411d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:46.636552 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ab236-ebb7-4242-9597-6effa21411d3 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:46.636843 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ab236-ebb7-4242-9597-6effa21411d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:46.637167 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ab236-ebb7-4242-9597-6effa21411d3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:46.648969 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ab236-ebb7-4242-9597-6effa21411d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:46.654055 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-b18ab236-ebb7-4242-9597-6effa21411d3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:05:46.654055 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:46.654055 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:46.654055 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:46.654055 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:46.654055 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:46.654055 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:46.654055 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:46.654055 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:46.654055 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:46.654055 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:46.654055 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:46.654055 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:46.654055 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:46.654055 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:46.654055 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:46.654965 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:46.654965 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:46.654965 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:46.654965 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:46.654965 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:46.654965 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:46.654965 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:46.654965 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:46.654965 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:46.654965 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:46.654965 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:46.654965 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:46.654965 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:46.654965 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:46.654965 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:46.654965 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:46.656284 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:46.656284 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:46.656284 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:46.656284 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:46.656284 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:46.656284 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:46.656284 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:46.656284 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:46.656284 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:46.656284 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:46.656284 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:05:46.656284 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:05:46.656284 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 134/282] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:05:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:05:46.664276 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146691fc-aa93-4d94-9d7c-ab7b7a7dbc42 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:46.804158 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146691fc-aa93-4d94-9d7c-ab7b7a7dbc42 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:46.853649 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eed13d-d3e4-443d-9beb-73e4bb1e819c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:46.854226 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eed13d-d3e4-443d-9beb-73e4bb1e819c None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:46.854520 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eed13d-d3e4-443d-9beb-73e4bb1e819c None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:46.854794 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eed13d-d3e4-443d-9beb-73e4bb1e819c None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:46.855720 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eed13d-d3e4-443d-9beb-73e4bb1e819c None admin] RBAC: Adding query filter params (name=reader) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:46.856030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eed13d-d3e4-443d-9beb-73e4bb1e819c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:46.857425 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eed13d-d3e4-443d-9beb-73e4bb1e819c None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:46.872680 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 149/283] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 9 11:05:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:46.879395 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ab236-ebb7-4242-9597-6effa21411d3 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:46.989931 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:46.994821 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55aab36-0a7b-4af4-b827-c03fb704fe2d None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:46.995102 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55aab36-0a7b-4af4-b827-c03fb704fe2d None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:46.995376 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55aab36-0a7b-4af4-b827-c03fb704fe2d None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:46.996935 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 150/284] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:47.004006 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7eb6e9-3efa-433f-b613-96a94faec93a None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:47.004281 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7eb6e9-3efa-433f-b613-96a94faec93a None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:47.004560 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7eb6e9-3efa-433f-b613-96a94faec93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:47.030394 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-1d7eb6e9-3efa-433f-b613-96a94faec93a None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:47.031602 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-1d7eb6e9-3efa-433f-b613-96a94faec93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:47.032979 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ab236-ebb7-4242-9597-6effa21411d3 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:47.097564 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:47.109195 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4935d3d-8240-4ee9-8197-7b7d2fe9f846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:47.109800 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4935d3d-8240-4ee9-8197-7b7d2fe9f846 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:47.110255 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4935d3d-8240-4ee9-8197-7b7d2fe9f846 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:47.110382 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 151/285] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 09 11:05:47.111277 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4935d3d-8240-4ee9-8197-7b7d2fe9f846 None admin] PATH_INFO: `/v3/users/d55a6e67c75b4693b951879e31e8a2a6` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:47.114361 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4935d3d-8240-4ee9-8197-7b7d2fe9f846 None admin] RBAC: Authorizing `identity:get_user(user_id=d55a6e67c75b4693b951879e31e8a2a6)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:47.116771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4935d3d-8240-4ee9-8197-7b7d2fe9f846 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:47.126525 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 135/286] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:46 2022] GET /identity/v3/users/d55a6e67c75b4693b951879e31e8a2a6 => generated 297 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:47.134369 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7eb6e9-3efa-433f-b613-96a94faec93a None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:47.331672 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7eb6e9-3efa-433f-b613-96a94faec93a None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:47.391043 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ace33d-49b5-4b85-b188-d53d25a5ac4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:47.391923 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ace33d-49b5-4b85-b188-d53d25a5ac4a None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:47.392363 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ace33d-49b5-4b85-b188-d53d25a5ac4a None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:47.392773 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ace33d-49b5-4b85-b188-d53d25a5ac4a None admin] PATH_INFO: `/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:47.394083 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ace33d-49b5-4b85-b188-d53d25a5ac4a None admin] RBAC: Authorizing `identity:get_project(project_id=73f314874b5a4cbcb9f77b3c1c53b198)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:47.395650 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ace33d-49b5-4b85-b188-d53d25a5ac4a None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:47.397748 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 152/287] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:05:47 2022] GET /identity/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:47.406602 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4935d3d-8240-4ee9-8197-7b7d2fe9f846 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:47.494451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ace33d-49b5-4b85-b188-d53d25a5ac4a None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:47.573644 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:47.586424 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4935d3d-8240-4ee9-8197-7b7d2fe9f846 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:47.625524 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ace33d-49b5-4b85-b188-d53d25a5ac4a None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:47.657113 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52f3e3-36bd-451f-85bf-8f423bb3b79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:47.657734 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52f3e3-36bd-451f-85bf-8f423bb3b79b None admin] REQUEST_METHOD: `PUT` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:47.658007 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52f3e3-36bd-451f-85bf-8f423bb3b79b None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:47.658278 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52f3e3-36bd-451f-85bf-8f423bb3b79b None admin] PATH_INFO: `/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198/users/d55a6e67c75b4693b951879e31e8a2a6/roles/47e69ff304f7450a8a1810bd5b95b1f2` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:47.662496 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52f3e3-36bd-451f-85bf-8f423bb3b79b None admin] RBAC: Authorizing `identity:create_grant(project_id=73f314874b5a4cbcb9f77b3c1c53b198, user_id=d55a6e67c75b4693b951879e31e8a2a6, role_id=47e69ff304f7450a8a1810bd5b95b1f2)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:47.663944 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52f3e3-36bd-451f-85bf-8f423bb3b79b None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:47.688230 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 136/288] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 9 11:05:47 2022] PUT /identity/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198/users/d55a6e67c75b4693b951879e31e8a2a6/roles/47e69ff304f7450a8a1810bd5b95b1f2 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:05:47.691812 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307d278-1ffd-429f-9b71-9c352224fe8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:47.692781 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307d278-1ffd-429f-9b71-9c352224fe8e None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:47.693212 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307d278-1ffd-429f-9b71-9c352224fe8e None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:47.693718 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307d278-1ffd-429f-9b71-9c352224fe8e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:47.708308 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307d278-1ffd-429f-9b71-9c352224fe8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:47.715721 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-0307d278-1ffd-429f-9b71-9c352224fe8e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:05:47.715721 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:47.715721 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:47.715721 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:47.715721 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:47.715721 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:47.715721 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:47.715721 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:47.715721 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:47.715721 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:47.715721 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:47.715721 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:47.715721 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:47.715721 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:47.715721 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:47.715721 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:47.716716 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:47.716716 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:47.716716 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:47.716716 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:47.716716 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:47.716716 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:47.716716 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:47.716716 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:47.716716 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:47.716716 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:47.716716 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:47.716716 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:47.716716 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:47.716716 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:47.716716 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:47.716716 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:47.718088 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:47.718088 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:47.718088 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:47.718088 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:47.718088 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:47.718088 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:47.718088 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:47.718088 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:47.718088 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:47.718088 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:47.718088 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:05:47.718088 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:05:47.718088 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 153/289] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:05:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:05:47.725372 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52f3e3-36bd-451f-85bf-8f423bb3b79b None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:47.752777 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:47.891184 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52f3e3-36bd-451f-85bf-8f423bb3b79b None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:47.946151 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb7768-457a-4e3d-aead-0895e37a5042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:47.946704 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb7768-457a-4e3d-aead-0895e37a5042 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:47.946977 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb7768-457a-4e3d-aead-0895e37a5042 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:47.947242 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb7768-457a-4e3d-aead-0895e37a5042 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:47.947919 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb7768-457a-4e3d-aead-0895e37a5042 None admin] RBAC: Adding query filter params (name=member) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:47.948215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb7768-457a-4e3d-aead-0895e37a5042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:47.949636 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb7768-457a-4e3d-aead-0895e37a5042 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:47.959716 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 137/290] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 9 11:05:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:47.965551 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307d278-1ffd-429f-9b71-9c352224fe8e None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:48.109702 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307d278-1ffd-429f-9b71-9c352224fe8e None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:48.135290 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:48.156038 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d869f6-02d5-4b1d-a07b-b35a048a0bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:48.156696 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d869f6-02d5-4b1d-a07b-b35a048a0bc4 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:48.156971 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d869f6-02d5-4b1d-a07b-b35a048a0bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:48.157242 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d869f6-02d5-4b1d-a07b-b35a048a0bc4 None admin] PATH_INFO: `/v3/users/237d04f85ddc4091a436e833d1d605b0` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:48.158496 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d869f6-02d5-4b1d-a07b-b35a048a0bc4 None admin] RBAC: Authorizing `identity:get_user(user_id=237d04f85ddc4091a436e833d1d605b0)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:48.160094 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d869f6-02d5-4b1d-a07b-b35a048a0bc4 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:48.162148 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 154/291] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:47 2022] GET /identity/v3/users/237d04f85ddc4091a436e833d1d605b0 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:48.168282 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb7768-457a-4e3d-aead-0895e37a5042 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:48.282994 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:48.337794 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb7768-457a-4e3d-aead-0895e37a5042 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:48.375643 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d10ac-3d1c-46b8-af45-83aa6490028a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:48.376265 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d10ac-3d1c-46b8-af45-83aa6490028a None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:48.376547 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d10ac-3d1c-46b8-af45-83aa6490028a None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:48.376823 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d10ac-3d1c-46b8-af45-83aa6490028a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:48.460344 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d10ac-3d1c-46b8-af45-83aa6490028a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:48.461868 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d10ac-3d1c-46b8-af45-83aa6490028a None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:48.542691 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:48.583408 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502dd5d-0501-4047-8736-65ffb6de97f9 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:48.583720 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502dd5d-0501-4047-8736-65ffb6de97f9 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:48.583957 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502dd5d-0501-4047-8736-65ffb6de97f9 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:48.585551 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 155/292] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:48.596829 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 138/293] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:05:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:05:48.601633 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581fb9c-1797-42e0-859c-ce8fda75ee04 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:48.602129 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581fb9c-1797-42e0-859c-ce8fda75ee04 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:48.602412 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581fb9c-1797-42e0-859c-ce8fda75ee04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:48.603182 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d10ac-3d1c-46b8-af45-83aa6490028a None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:48.637329 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-8581fb9c-1797-42e0-859c-ce8fda75ee04 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:48.637329 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-8581fb9c-1797-42e0-859c-ce8fda75ee04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:48.740013 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 156/294] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:48.742241 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457445f-62f5-4270-9512-be8ef98dabdf None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:48.742770 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457445f-62f5-4270-9512-be8ef98dabdf None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:48.743243 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457445f-62f5-4270-9512-be8ef98dabdf None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:48.744751 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 157/295] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:48.750970 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96362db7-4f57-4ec6-a2c4-5d674c2a4ef3 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:48.751627 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96362db7-4f57-4ec6-a2c4-5d674c2a4ef3 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:48.752106 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96362db7-4f57-4ec6-a2c4-5d674c2a4ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:48.768635 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d10ac-3d1c-46b8-af45-83aa6490028a None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:48.775137 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-96362db7-4f57-4ec6-a2c4-5d674c2a4ef3 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:48.776975 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-96362db7-4f57-4ec6-a2c4-5d674c2a4ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:48.810580 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4635b-9201-4e9e-9bab-3d1208cc0d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:48.811176 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4635b-9201-4e9e-9bab-3d1208cc0d4a None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:48.811493 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4635b-9201-4e9e-9bab-3d1208cc0d4a None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:48.811853 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4635b-9201-4e9e-9bab-3d1208cc0d4a None admin] PATH_INFO: `/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:48.813147 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4635b-9201-4e9e-9bab-3d1208cc0d4a None admin] RBAC: Authorizing `identity:get_project(project_id=73f314874b5a4cbcb9f77b3c1c53b198)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:48.814677 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4635b-9201-4e9e-9bab-3d1208cc0d4a None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:48.816367 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 139/296] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:05:48 2022] GET /identity/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:48.822701 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4635b-9201-4e9e-9bab-3d1208cc0d4a None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:48.880262 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:48.895874 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 158/297] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:05:48.926090 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9fe69-5b23-4334-ac32-b73c0d1d906d None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:48.926405 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9fe69-5b23-4334-ac32-b73c0d1d906d None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:48.926632 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9fe69-5b23-4334-ac32-b73c0d1d906d None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:48.928277 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 159/298] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:05:48.933385 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293e8b4-9809-4ad7-aa76-720b173853e1 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:48.933668 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293e8b4-9809-4ad7-aa76-720b173853e1 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:48.933942 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293e8b4-9809-4ad7-aa76-720b173853e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:48.949315 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4635b-9201-4e9e-9bab-3d1208cc0d4a None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:48.951827 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-6293e8b4-9809-4ad7-aa76-720b173853e1 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:48.952993 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-6293e8b4-9809-4ad7-aa76-720b173853e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:48.991833 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e2adf-b6c4-43a3-ae9c-aa83b69d844c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:48.992436 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e2adf-b6c4-43a3-ae9c-aa83b69d844c None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:48.992707 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e2adf-b6c4-43a3-ae9c-aa83b69d844c None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:48.992974 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e2adf-b6c4-43a3-ae9c-aa83b69d844c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:48.993768 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e2adf-b6c4-43a3-ae9c-aa83b69d844c None admin] RBAC: Adding query filter params (role.id=cf09a959c760483db0dff049f84e5482, scope.project.id=73f314874b5a4cbcb9f77b3c1c53b198, user.id=237d04f85ddc4091a436e833d1d605b0) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:48.994068 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e2adf-b6c4-43a3-ae9c-aa83b69d844c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:48.995567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e2adf-b6c4-43a3-ae9c-aa83b69d844c None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:49.000929 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:49.003281 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 140/299] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:05:48 2022] GET /identity/v3/role_assignments?user.id=237d04f85ddc4091a436e833d1d605b0&scope.project.id=73f314874b5a4cbcb9f77b3c1c53b198&role.id=cf09a959c760483db0dff049f84e5482 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:49.028930 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 160/300] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:05:49.237835 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e2adf-b6c4-43a3-ae9c-aa83b69d844c None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:49.364569 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e2adf-b6c4-43a3-ae9c-aa83b69d844c None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:49.367746 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:49.387077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293e8b4-9809-4ad7-aa76-720b173853e1 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:49.417135 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b910ba9-3e59-42c7-9861-1c79bfd0a2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:49.417799 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b910ba9-3e59-42c7-9861-1c79bfd0a2c8 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:49.418107 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b910ba9-3e59-42c7-9861-1c79bfd0a2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:49.418357 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b910ba9-3e59-42c7-9861-1c79bfd0a2c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:49.433781 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b910ba9-3e59-42c7-9861-1c79bfd0a2c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:49.443108 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-1b910ba9-3e59-42c7-9861-1c79bfd0a2c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:05:49.443108 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:49.443108 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:49.443108 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:49.443108 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:49.443108 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:49.443108 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:49.443108 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:49.443108 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:49.443108 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:49.443108 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:49.443108 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:49.443108 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:49.443108 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:49.443108 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:49.443108 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:49.444138 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:49.444138 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:49.444138 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:49.444138 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:49.444138 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:49.444138 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:49.444138 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:49.444138 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:49.444138 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:49.444138 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:49.444138 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:49.444138 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:49.444138 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:49.444138 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:49.444138 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:49.444138 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:49.444960 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:49.444960 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:49.444960 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:49.444960 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:49.444960 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:49.444960 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:49.444960 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:49.444960 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:49.444960 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:49.444960 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:49.444960 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:05:49.444960 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:05:49.447983 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 141/301] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:05:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:05:49.450662 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b910ba9-3e59-42c7-9861-1c79bfd0a2c8 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:49.515455 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293e8b4-9809-4ad7-aa76-720b173853e1 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:49.560533 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cccb01-416f-477c-a563-b12b8c5cf67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:49.561381 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cccb01-416f-477c-a563-b12b8c5cf67f None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:49.561669 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cccb01-416f-477c-a563-b12b8c5cf67f None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:49.561929 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cccb01-416f-477c-a563-b12b8c5cf67f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:49.563091 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cccb01-416f-477c-a563-b12b8c5cf67f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:49.564526 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cccb01-416f-477c-a563-b12b8c5cf67f None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:49.570551 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 161/302] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:05:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:49.570551 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cccb01-416f-477c-a563-b12b8c5cf67f None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:49.586489 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b910ba9-3e59-42c7-9861-1c79bfd0a2c8 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:49.625274 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:49.636816 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e9c2d-9e1d-4c0c-962e-5e408388bc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:49.638135 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e9c2d-9e1d-4c0c-962e-5e408388bc80 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:49.638615 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e9c2d-9e1d-4c0c-962e-5e408388bc80 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:49.638968 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e9c2d-9e1d-4c0c-962e-5e408388bc80 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:49.640305 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e9c2d-9e1d-4c0c-962e-5e408388bc80 None admin] RBAC: Adding query filter params (name=member) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:49.640558 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e9c2d-9e1d-4c0c-962e-5e408388bc80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:49.641984 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e9c2d-9e1d-4c0c-962e-5e408388bc80 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:49.656441 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 142/303] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 9 11:05:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:05:49.656441 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e9c2d-9e1d-4c0c-962e-5e408388bc80 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:49.698024 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cccb01-416f-477c-a563-b12b8c5cf67f None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:49.699977 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:49.747779 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea7d71-a7c7-4a3e-808b-f4d4264e1151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:49.748415 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea7d71-a7c7-4a3e-808b-f4d4264e1151 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:49.749233 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea7d71-a7c7-4a3e-808b-f4d4264e1151 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:49.749562 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea7d71-a7c7-4a3e-808b-f4d4264e1151 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:49.766990 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea7d71-a7c7-4a3e-808b-f4d4264e1151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:49.772714 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-a7ea7d71-a7c7-4a3e-808b-f4d4264e1151 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:05:49.772714 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:49.772714 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:49.772714 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:49.772714 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:49.772714 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:49.772714 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:49.772714 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:49.772714 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:49.772714 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:49.772714 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:49.772714 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:49.772714 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:49.772714 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:49.772714 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:49.772714 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:49.773731 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:49.773731 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:49.773731 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:49.773731 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:49.773731 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:49.773731 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:49.773731 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:49.773731 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:49.773731 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:49.773731 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:49.773731 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:49.773731 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:49.773731 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:49.773731 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:49.773731 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:49.773731 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:49.774533 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:49.774533 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:49.774533 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:49.774533 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:49.774533 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:49.774533 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:49.774533 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:49.774533 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:49.774533 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:49.774533 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:49.774533 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:05:49.774533 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:05:49.778567 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 162/304] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:05:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:05:49.779466 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea7d71-a7c7-4a3e-808b-f4d4264e1151 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:49.791673 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e9c2d-9e1d-4c0c-962e-5e408388bc80 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:49.828619 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f029006-b46f-4b92-a7e2-a01776b3c585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:49.829347 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f029006-b46f-4b92-a7e2-a01776b3c585 None admin] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:49.829630 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f029006-b46f-4b92-a7e2-a01776b3c585 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:49.829900 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f029006-b46f-4b92-a7e2-a01776b3c585 None admin] PATH_INFO: `/v3/groups` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:49.830639 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f029006-b46f-4b92-a7e2-a01776b3c585 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:49.831999 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f029006-b46f-4b92-a7e2-a01776b3c585 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:49.848282 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 143/305] 10.222.0.20 () {60 vars in 1134 bytes} [Fri Sep 9 11:05:49 2022] POST /identity/v3/groups => generated 229 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:05:49.849107 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f029006-b46f-4b92-a7e2-a01776b3c585 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:49.915913 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea7d71-a7c7-4a3e-808b-f4d4264e1151 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:49.927538 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:49.960861 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:49.970462 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3c61b-2ef9-41de-a8b5-49b63bcf7a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:49.971265 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3c61b-2ef9-41de-a8b5-49b63bcf7a00 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:49.971546 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3c61b-2ef9-41de-a8b5-49b63bcf7a00 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:49.971816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3c61b-2ef9-41de-a8b5-49b63bcf7a00 None admin] PATH_INFO: `/v3/users/87e74acd32d341af8f17482f0b1a90de` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:49.973170 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3c61b-2ef9-41de-a8b5-49b63bcf7a00 None admin] RBAC: Authorizing `identity:get_user(user_id=87e74acd32d341af8f17482f0b1a90de)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:49.974692 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3c61b-2ef9-41de-a8b5-49b63bcf7a00 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:49.980839 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 163/306] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:49 2022] GET /identity/v3/users/87e74acd32d341af8f17482f0b1a90de => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:49.984147 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3c61b-2ef9-41de-a8b5-49b63bcf7a00 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:49.994170 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f029006-b46f-4b92-a7e2-a01776b3c585 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:50.043927 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579dcbc4-dec0-4c40-8c15-fe86206fe1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:50.045227 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579dcbc4-dec0-4c40-8c15-fe86206fe1ed None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:50.046389 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579dcbc4-dec0-4c40-8c15-fe86206fe1ed None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:50.046952 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579dcbc4-dec0-4c40-8c15-fe86206fe1ed None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:50.047964 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579dcbc4-dec0-4c40-8c15-fe86206fe1ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:50.048477 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579dcbc4-dec0-4c40-8c15-fe86206fe1ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:50.050211 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579dcbc4-dec0-4c40-8c15-fe86206fe1ed None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:50.062749 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 144/307] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 9 11:05:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:50.068946 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579dcbc4-dec0-4c40-8c15-fe86206fe1ed None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:50.116404 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3c61b-2ef9-41de-a8b5-49b63bcf7a00 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:50.162706 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25f021-ef93-4ea3-b47a-10da5b7916ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:50.164250 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25f021-ef93-4ea3-b47a-10da5b7916ae None admin] REQUEST_METHOD: `PUT` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:50.164748 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25f021-ef93-4ea3-b47a-10da5b7916ae None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:50.165233 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25f021-ef93-4ea3-b47a-10da5b7916ae None admin] PATH_INFO: `/v3/system/users/87e74acd32d341af8f17482f0b1a90de/roles/cf09a959c760483db0dff049f84e5482` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:50.166812 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25f021-ef93-4ea3-b47a-10da5b7916ae None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=87e74acd32d341af8f17482f0b1a90de, role_id=cf09a959c760483db0dff049f84e5482)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:50.168214 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25f021-ef93-4ea3-b47a-10da5b7916ae None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:50.180110 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 164/308] 10.222.0.20 () {58 vars in 1334 bytes} [Fri Sep 9 11:05:49 2022] PUT /identity/v3/system/users/87e74acd32d341af8f17482f0b1a90de/roles/cf09a959c760483db0dff049f84e5482 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:05:50.208674 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579dcbc4-dec0-4c40-8c15-fe86206fe1ed None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:50.256876 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecd800-2bc2-489d-9428-58ed7731f635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:50.257856 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecd800-2bc2-489d-9428-58ed7731f635 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:50.258324 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecd800-2bc2-489d-9428-58ed7731f635 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:50.258754 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecd800-2bc2-489d-9428-58ed7731f635 None admin] PATH_INFO: `/v3/users/7b1c3c9bb91f4415ab625d7cc843100d` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:50.275796 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ecd800-2bc2-489d-9428-58ed7731f635 None admin] RBAC: Authorizing `identity:get_user(user_id=7b1c3c9bb91f4415ab625d7cc843100d)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:50.277691 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ecd800-2bc2-489d-9428-58ed7731f635 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:50.279816 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 145/309] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:50 2022] GET /identity/v3/users/7b1c3c9bb91f4415ab625d7cc843100d => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:50.286331 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25f021-ef93-4ea3-b47a-10da5b7916ae None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:50.345542 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:50.429210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25f021-ef93-4ea3-b47a-10da5b7916ae None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:50.473642 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae959f20-b5a2-4b51-972e-ed222bed2ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:50.474513 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae959f20-b5a2-4b51-972e-ed222bed2ac5 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:50.474965 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae959f20-b5a2-4b51-972e-ed222bed2ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:50.475377 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae959f20-b5a2-4b51-972e-ed222bed2ac5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:50.476237 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae959f20-b5a2-4b51-972e-ed222bed2ac5 None admin] RBAC: Adding query filter params (role.id=47e69ff304f7450a8a1810bd5b95b1f2, user.id=7b1c3c9bb91f4415ab625d7cc843100d, scope.system=all) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:50.476683 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae959f20-b5a2-4b51-972e-ed222bed2ac5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:50.478279 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae959f20-b5a2-4b51-972e-ed222bed2ac5 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:50.485642 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 165/310] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Sep 9 11:05:50 2022] GET /identity/v3/role_assignments?user.id=7b1c3c9bb91f4415ab625d7cc843100d&scope.system=all&role.id=47e69ff304f7450a8a1810bd5b95b1f2 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:50.718061 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6426cfa-20c3-4a03-a377-c5307185b837 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:50.718624 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6426cfa-20c3-4a03-a377-c5307185b837 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:50.718835 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6426cfa-20c3-4a03-a377-c5307185b837 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:50.720430 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 146/311] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:50.725706 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d062e-d2c2-4b5a-9ec2-db4f7fff9d5c None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:50.726153 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d062e-d2c2-4b5a-9ec2-db4f7fff9d5c None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:50.726429 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d062e-d2c2-4b5a-9ec2-db4f7fff9d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:50.745843 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-001d062e-d2c2-4b5a-9ec2-db4f7fff9d5c None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:50.747028 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-001d062e-d2c2-4b5a-9ec2-db4f7fff9d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:50.817683 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 166/312] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:51.143158 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6426cfa-20c3-4a03-a377-c5307185b837 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:51.152465 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:51.257906 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6426cfa-20c3-4a03-a377-c5307185b837 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:51.294127 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a015ab5-2948-48b9-9ca5-81621b659cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:51.295025 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a015ab5-2948-48b9-9ca5-81621b659cbf None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:51.295305 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a015ab5-2948-48b9-9ca5-81621b659cbf None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:51.295691 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a015ab5-2948-48b9-9ca5-81621b659cbf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:51.306475 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a015ab5-2948-48b9-9ca5-81621b659cbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:51.311903 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-0a015ab5-2948-48b9-9ca5-81621b659cbf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:05:51.311903 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:51.311903 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:51.311903 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:51.311903 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:51.311903 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:51.311903 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:51.311903 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:51.311903 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:51.311903 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:51.311903 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:51.311903 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:51.311903 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:51.311903 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:51.311903 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:51.311903 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:51.312809 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:51.312809 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:51.312809 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:51.312809 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:51.312809 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:51.312809 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:51.312809 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:51.312809 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:51.312809 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:51.312809 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:51.312809 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:51.312809 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:51.312809 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:51.312809 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:51.312809 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:51.312809 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:51.313662 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:51.313662 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:51.313662 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:51.313662 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:51.313662 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:51.313662 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:51.313662 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:51.313662 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:51.313662 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:51.313662 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:51.313662 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:05:51.313662 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:05:51.313662 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 147/313] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:05:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:05:51.318985 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d062e-d2c2-4b5a-9ec2-db4f7fff9d5c None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:51.350693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:51.426837 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d062e-d2c2-4b5a-9ec2-db4f7fff9d5c None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:51.464056 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988e99b-1c41-470e-b84c-45640a02dc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:51.464687 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988e99b-1c41-470e-b84c-45640a02dc3c None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:51.464977 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988e99b-1c41-470e-b84c-45640a02dc3c None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:51.465254 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988e99b-1c41-470e-b84c-45640a02dc3c None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:51.465953 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988e99b-1c41-470e-b84c-45640a02dc3c None admin] RBAC: Adding query filter params (name=reader) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:51.466264 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988e99b-1c41-470e-b84c-45640a02dc3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:51.468600 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988e99b-1c41-470e-b84c-45640a02dc3c None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:51.478025 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 167/314] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 9 11:05:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:51.483462 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a015ab5-2948-48b9-9ca5-81621b659cbf None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:51.573583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:51.611700 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a015ab5-2948-48b9-9ca5-81621b659cbf None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:51.648137 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8b146-4bb9-438a-b93e-0b48606b7472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:51.648781 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8b146-4bb9-438a-b93e-0b48606b7472 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:51.649059 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8b146-4bb9-438a-b93e-0b48606b7472 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:51.649352 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8b146-4bb9-438a-b93e-0b48606b7472 None admin] PATH_INFO: `/v3/users/d55a6e67c75b4693b951879e31e8a2a6` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:51.650505 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8b146-4bb9-438a-b93e-0b48606b7472 None admin] RBAC: Authorizing `identity:get_user(user_id=d55a6e67c75b4693b951879e31e8a2a6)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:51.651968 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8b146-4bb9-438a-b93e-0b48606b7472 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:51.654054 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 148/315] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:51 2022] GET /identity/v3/users/d55a6e67c75b4693b951879e31e8a2a6 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:51.659326 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988e99b-1c41-470e-b84c-45640a02dc3c None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:51.763413 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:51.773885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988e99b-1c41-470e-b84c-45640a02dc3c None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:51.809928 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8781b-7d9a-4378-8f35-1d53cf719031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:51.810540 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8781b-7d9a-4378-8f35-1d53cf719031 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:51.810815 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8781b-7d9a-4378-8f35-1d53cf719031 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:51.811170 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8781b-7d9a-4378-8f35-1d53cf719031 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:51.880273 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a8781b-7d9a-4378-8f35-1d53cf719031 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:51.881768 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a8781b-7d9a-4378-8f35-1d53cf719031 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:51.975293 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:51.982749 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 168/316] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:05:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:05:51.988367 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8b146-4bb9-438a-b93e-0b48606b7472 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:52.100641 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8b146-4bb9-438a-b93e-0b48606b7472 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:52.138933 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87116be5-cb62-45b4-b306-8498230480f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:52.139689 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87116be5-cb62-45b4-b306-8498230480f0 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:52.140013 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87116be5-cb62-45b4-b306-8498230480f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:52.140283 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87116be5-cb62-45b4-b306-8498230480f0 None admin] PATH_INFO: `/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:52.141565 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87116be5-cb62-45b4-b306-8498230480f0 None admin] RBAC: Authorizing `identity:get_project(project_id=73f314874b5a4cbcb9f77b3c1c53b198)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:52.143070 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87116be5-cb62-45b4-b306-8498230480f0 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:52.145257 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 149/317] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:05:51 2022] GET /identity/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:52.150775 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8781b-7d9a-4378-8f35-1d53cf719031 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:52.258236 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8781b-7d9a-4378-8f35-1d53cf719031 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:52.294186 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72dfaa8-0de7-4082-a60a-12cd18f0011e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:52.295059 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72dfaa8-0de7-4082-a60a-12cd18f0011e None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:52.295340 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72dfaa8-0de7-4082-a60a-12cd18f0011e None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:52.295688 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72dfaa8-0de7-4082-a60a-12cd18f0011e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:52.296413 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72dfaa8-0de7-4082-a60a-12cd18f0011e None admin] RBAC: Adding query filter params (role.id=47e69ff304f7450a8a1810bd5b95b1f2, scope.project.id=73f314874b5a4cbcb9f77b3c1c53b198, user.id=d55a6e67c75b4693b951879e31e8a2a6) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:52.296723 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72dfaa8-0de7-4082-a60a-12cd18f0011e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:52.298223 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72dfaa8-0de7-4082-a60a-12cd18f0011e None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:52.305030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 169/318] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:05:52 2022] GET /identity/v3/role_assignments?user.id=d55a6e67c75b4693b951879e31e8a2a6&scope.project.id=73f314874b5a4cbcb9f77b3c1c53b198&role.id=47e69ff304f7450a8a1810bd5b95b1f2 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:52.601994 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1beb84-c4c7-4610-a25d-97f4016f2c7d None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:52.602357 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1beb84-c4c7-4610-a25d-97f4016f2c7d None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:52.602660 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1beb84-c4c7-4610-a25d-97f4016f2c7d None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:52.604294 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 150/319] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:52.610510 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682e0d2-b16b-45cf-b79a-599af5fee4f3 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:52.610788 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682e0d2-b16b-45cf-b79a-599af5fee4f3 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:52.611044 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682e0d2-b16b-45cf-b79a-599af5fee4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:52.630045 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-3682e0d2-b16b-45cf-b79a-599af5fee4f3 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:52.631245 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-3682e0d2-b16b-45cf-b79a-599af5fee4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:52.692177 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:52.712917 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 170/320] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:52.842928 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371b619-a209-434c-aeee-efa25bf15523 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:52.843249 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371b619-a209-434c-aeee-efa25bf15523 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:52.843484 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371b619-a209-434c-aeee-efa25bf15523 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:52.844969 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 151/321] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:05:52.850099 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7174c9-4640-4bdc-9d18-537c0e2ed0da None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:52.850371 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7174c9-4640-4bdc-9d18-537c0e2ed0da None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:52.850709 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7174c9-4640-4bdc-9d18-537c0e2ed0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:52.868787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-7c7174c9-4640-4bdc-9d18-537c0e2ed0da None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:52.869920 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-7c7174c9-4640-4bdc-9d18-537c0e2ed0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:52.937733 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 171/322] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:52.943769 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ba976-bf2f-44e9-8bfb-8692d2b04c42 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:52.944128 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ba976-bf2f-44e9-8bfb-8692d2b04c42 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:52.944475 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ba976-bf2f-44e9-8bfb-8692d2b04c42 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:52.946026 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 152/323] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:52.951022 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f4c1c-0133-45ac-bdb8-2ce4965a2d40 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:52.951313 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f4c1c-0133-45ac-bdb8-2ce4965a2d40 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:52.951698 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f4c1c-0133-45ac-bdb8-2ce4965a2d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:52.970138 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-9c1f4c1c-0133-45ac-bdb8-2ce4965a2d40 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:52.971368 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-9c1f4c1c-0133-45ac-bdb8-2ce4965a2d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:53.035158 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ba976-bf2f-44e9-8bfb-8692d2b04c42 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:53.038360 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:53.038872 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 172/324] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:53.137713 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ba976-bf2f-44e9-8bfb-8692d2b04c42 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:53.172130 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ce20d-388e-47ea-ba8c-b9c06fcd7813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:53.172753 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ce20d-388e-47ea-ba8c-b9c06fcd7813 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:53.173026 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ce20d-388e-47ea-ba8c-b9c06fcd7813 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:53.173316 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ce20d-388e-47ea-ba8c-b9c06fcd7813 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:53.174383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ce20d-388e-47ea-ba8c-b9c06fcd7813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:53.175794 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ce20d-388e-47ea-ba8c-b9c06fcd7813 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:53.177519 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 153/325] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:05:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:05:53.183014 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f4c1c-0133-45ac-bdb8-2ce4965a2d40 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:53.236381 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:53.262676 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ce20d-388e-47ea-ba8c-b9c06fcd7813 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:53.288508 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f4c1c-0133-45ac-bdb8-2ce4965a2d40 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:53.327586 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f485b-4a73-42f0-8343-b4d5843f3370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:53.328322 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f485b-4a73-42f0-8343-b4d5843f3370 None admin] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:53.328606 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f485b-4a73-42f0-8343-b4d5843f3370 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:53.328875 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f485b-4a73-42f0-8343-b4d5843f3370 None admin] PATH_INFO: `/v3/groups` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:53.329542 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f485b-4a73-42f0-8343-b4d5843f3370 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:53.331217 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f485b-4a73-42f0-8343-b4d5843f3370 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:53.342552 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:53.350190 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 173/326] 10.222.0.20 () {60 vars in 1134 bytes} [Fri Sep 9 11:05:53 2022] POST /identity/v3/groups => generated 226 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:05:53.361378 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f485b-4a73-42f0-8343-b4d5843f3370 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:53.394836 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ce20d-388e-47ea-ba8c-b9c06fcd7813 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:53.432831 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d45de3-0646-45f0-b622-52b3db93db6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:53.433524 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d45de3-0646-45f0-b622-52b3db93db6e None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:53.433799 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d45de3-0646-45f0-b622-52b3db93db6e None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:53.434069 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d45de3-0646-45f0-b622-52b3db93db6e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:53.445858 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d45de3-0646-45f0-b622-52b3db93db6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:53.450871 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-d1d45de3-0646-45f0-b622-52b3db93db6e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:05:53.450871 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:53.450871 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:53.450871 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:53.450871 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:53.450871 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:53.450871 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:53.450871 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:53.450871 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:53.450871 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:53.450871 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:53.450871 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:53.450871 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:53.450871 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:53.450871 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:53.450871 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:53.452516 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:53.452516 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:53.452516 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:53.452516 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:53.452516 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:53.452516 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:53.452516 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:53.452516 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:53.452516 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:53.452516 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:53.452516 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:53.452516 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:53.452516 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:53.452516 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:53.452516 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:53.452516 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:53.453422 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:53.453422 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:53.453422 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:53.453422 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:53.453422 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:53.453422 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:53.453422 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:53.453422 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:53.453422 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:53.453422 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:53.453422 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:05:53.453422 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:05:53.457798 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 154/327] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:05:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:05:53.458630 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d45de3-0646-45f0-b622-52b3db93db6e None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:53.484266 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f485b-4a73-42f0-8343-b4d5843f3370 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:53.495225 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:53.527408 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f57d4-43f3-43b4-bf5e-80a958a4734d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:53.528078 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f57d4-43f3-43b4-bf5e-80a958a4734d None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:53.528361 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f57d4-43f3-43b4-bf5e-80a958a4734d None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:53.528635 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f57d4-43f3-43b4-bf5e-80a958a4734d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:53.542348 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f57d4-43f3-43b4-bf5e-80a958a4734d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:53.548210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-b31f57d4-43f3-43b4-bf5e-80a958a4734d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:05:53.548210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:53.548210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:53.548210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:53.548210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:53.548210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:53.548210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:53.548210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:53.548210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:53.548210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:53.548210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:53.548210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:53.548210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:53.548210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:53.548210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:53.548210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:53.549187 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:53.549187 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:53.549187 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:53.549187 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:53.549187 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:53.549187 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:53.549187 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:53.549187 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:53.549187 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:53.549187 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:53.549187 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:53.549187 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:53.549187 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:53.549187 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:53.549187 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:53.549187 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:53.550030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:53.550030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:53.550030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:53.550030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:53.550030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:53.550030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:53.550030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:53.550030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:53.550030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:53.550030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:53.550030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:05:53.550030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:05:53.550030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 174/328] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:05:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:05:53.555441 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f57d4-43f3-43b4-bf5e-80a958a4734d None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:53.573432 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d45de3-0646-45f0-b622-52b3db93db6e None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:53.611532 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:53.617660 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608d8ea-d09c-4009-9629-328eb54de85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:53.618284 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608d8ea-d09c-4009-9629-328eb54de85e None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:53.618565 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608d8ea-d09c-4009-9629-328eb54de85e None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:53.618846 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608d8ea-d09c-4009-9629-328eb54de85e None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:53.619504 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608d8ea-d09c-4009-9629-328eb54de85e None admin] RBAC: Adding query filter params (name=member) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:53.619803 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608d8ea-d09c-4009-9629-328eb54de85e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:53.621435 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608d8ea-d09c-4009-9629-328eb54de85e None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:53.632673 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 155/329] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 9 11:05:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:53.638193 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608d8ea-d09c-4009-9629-328eb54de85e None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:53.685140 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f57d4-43f3-43b4-bf5e-80a958a4734d None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:53.737051 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0beb79-92c0-4cdf-9e37-dee4377c2a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:53.738061 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0beb79-92c0-4cdf-9e37-dee4377c2a4e None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:53.738408 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0beb79-92c0-4cdf-9e37-dee4377c2a4e None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:53.738690 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0beb79-92c0-4cdf-9e37-dee4377c2a4e None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:53.739355 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0beb79-92c0-4cdf-9e37-dee4377c2a4e None admin] RBAC: Adding query filter params (name=reader) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:53.739657 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0beb79-92c0-4cdf-9e37-dee4377c2a4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:53.741020 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0beb79-92c0-4cdf-9e37-dee4377c2a4e None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:53.751935 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 175/330] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 9 11:05:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:05:53.758221 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0beb79-92c0-4cdf-9e37-dee4377c2a4e None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:53.769250 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608d8ea-d09c-4009-9629-328eb54de85e None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:53.801537 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:53.823756 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fe72c-c75f-4aee-8574-4ead91d49a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:53.824680 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fe72c-c75f-4aee-8574-4ead91d49a76 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:53.824962 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fe72c-c75f-4aee-8574-4ead91d49a76 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:53.825228 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fe72c-c75f-4aee-8574-4ead91d49a76 None admin] PATH_INFO: `/v3/users/87e74acd32d341af8f17482f0b1a90de` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:53.827534 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fe72c-c75f-4aee-8574-4ead91d49a76 None admin] RBAC: Authorizing `identity:get_user(user_id=87e74acd32d341af8f17482f0b1a90de)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:53.828981 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fe72c-c75f-4aee-8574-4ead91d49a76 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:53.831417 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 156/331] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:53 2022] GET /identity/v3/users/87e74acd32d341af8f17482f0b1a90de => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:05:53.837535 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fe72c-c75f-4aee-8574-4ead91d49a76 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:53.902521 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0beb79-92c0-4cdf-9e37-dee4377c2a4e None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:53.916813 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:53.943083 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e561d3-078c-43b6-9ed8-993522bd38e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:53.943622 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e561d3-078c-43b6-9ed8-993522bd38e2 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:53.943907 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e561d3-078c-43b6-9ed8-993522bd38e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:53.944175 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e561d3-078c-43b6-9ed8-993522bd38e2 None admin] PATH_INFO: `/v3/users/7b1c3c9bb91f4415ab625d7cc843100d` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:53.945324 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e561d3-078c-43b6-9ed8-993522bd38e2 None admin] RBAC: Authorizing `identity:get_user(user_id=7b1c3c9bb91f4415ab625d7cc843100d)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:53.946768 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e561d3-078c-43b6-9ed8-993522bd38e2 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:53.948653 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 176/332] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:05:53 2022] GET /identity/v3/users/7b1c3c9bb91f4415ab625d7cc843100d => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:53.955688 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e561d3-078c-43b6-9ed8-993522bd38e2 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:53.979458 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fe72c-c75f-4aee-8574-4ead91d49a76 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:54.025627 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae812b64-114a-4ac9-970d-732ed72d117e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:54.026248 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae812b64-114a-4ac9-970d-732ed72d117e None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:54.026526 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae812b64-114a-4ac9-970d-732ed72d117e None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:54.026797 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae812b64-114a-4ac9-970d-732ed72d117e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:54.027522 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae812b64-114a-4ac9-970d-732ed72d117e None admin] RBAC: Adding query filter params (role.id=cf09a959c760483db0dff049f84e5482, user.id=87e74acd32d341af8f17482f0b1a90de, scope.system=all) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:54.027829 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae812b64-114a-4ac9-970d-732ed72d117e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:54.029324 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae812b64-114a-4ac9-970d-732ed72d117e None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:54.042932 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 157/333] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Sep 9 11:05:53 2022] GET /identity/v3/role_assignments?user.id=87e74acd32d341af8f17482f0b1a90de&scope.system=all&role.id=cf09a959c760483db0dff049f84e5482 => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:54.101221 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:54.107012 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e561d3-078c-43b6-9ed8-993522bd38e2 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:54.151681 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b91c6-9636-4a80-8e48-6c54e08ce989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:54.152351 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b91c6-9636-4a80-8e48-6c54e08ce989 None admin] REQUEST_METHOD: `PUT` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:54.152679 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b91c6-9636-4a80-8e48-6c54e08ce989 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:54.152960 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b91c6-9636-4a80-8e48-6c54e08ce989 None admin] PATH_INFO: `/v3/system/users/7b1c3c9bb91f4415ab625d7cc843100d/roles/47e69ff304f7450a8a1810bd5b95b1f2` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:54.154508 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b91c6-9636-4a80-8e48-6c54e08ce989 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7b1c3c9bb91f4415ab625d7cc843100d, role_id=47e69ff304f7450a8a1810bd5b95b1f2)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:54.156057 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b91c6-9636-4a80-8e48-6c54e08ce989 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:54.168350 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 177/334] 10.222.0.20 () {58 vars in 1334 bytes} [Fri Sep 9 11:05:53 2022] PUT /identity/v3/system/users/7b1c3c9bb91f4415ab625d7cc843100d/roles/47e69ff304f7450a8a1810bd5b95b1f2 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:05:56.173879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfbd2e-00d0-4c55-824f-7c0f64caffd4 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:56.174854 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfbd2e-00d0-4c55-824f-7c0f64caffd4 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:56.175343 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfbd2e-00d0-4c55-824f-7c0f64caffd4 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:56.176874 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 158/335] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:56.182596 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be7aec-0b77-4abb-b3c0-e1f72cee4e44 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:56.183442 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be7aec-0b77-4abb-b3c0-e1f72cee4e44 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:56.184042 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be7aec-0b77-4abb-b3c0-e1f72cee4e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:56.205397 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-87be7aec-0b77-4abb-b3c0-e1f72cee4e44 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:56.206948 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-87be7aec-0b77-4abb-b3c0-e1f72cee4e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:56.280676 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 178/336] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:56.821423 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d385d3-d239-4171-9363-256b4cd102a8 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:56.821799 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d385d3-d239-4171-9363-256b4cd102a8 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:56.821981 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d385d3-d239-4171-9363-256b4cd102a8 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:56.823605 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 159/337] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:56.831393 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eedfca-6b83-4e3c-954b-9b2595e10b73 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:56.831690 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eedfca-6b83-4e3c-954b-9b2595e10b73 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:56.831941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eedfca-6b83-4e3c-954b-9b2595e10b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:56.854790 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-39eedfca-6b83-4e3c-954b-9b2595e10b73 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:56.855980 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-39eedfca-6b83-4e3c-954b-9b2595e10b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:56.938797 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 179/338] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:05:56.953216 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d385d3-d239-4171-9363-256b4cd102a8 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:57.099474 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d385d3-d239-4171-9363-256b4cd102a8 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:57.123866 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:57.142776 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930c7a2-88ed-4601-bd27-514e79f5e60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:57.143762 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930c7a2-88ed-4601-bd27-514e79f5e60d None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:57.144265 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930c7a2-88ed-4601-bd27-514e79f5e60d None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:57.144726 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930c7a2-88ed-4601-bd27-514e79f5e60d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:57.164246 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930c7a2-88ed-4601-bd27-514e79f5e60d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:57.169879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-b930c7a2-88ed-4601-bd27-514e79f5e60d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:05:57.169879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:57.169879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:57.169879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:57.169879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:57.169879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:57.169879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:57.169879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:57.169879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:57.169879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:57.169879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:57.169879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:57.169879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:57.169879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:57.169879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:57.169879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:57.170831 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:57.170831 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:57.170831 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:57.170831 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:57.170831 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:57.170831 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:57.170831 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:57.170831 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:57.170831 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:57.170831 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:57.170831 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:57.170831 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:57.170831 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:57.170831 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:57.170831 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:57.170831 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:57.171675 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:57.171675 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:57.171675 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:57.171675 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:57.171675 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:57.171675 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:57.171675 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:57.171675 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:57.171675 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:57.171675 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:57.171675 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:05:57.171675 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:05:57.178952 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 160/339] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:05:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:05:57.182932 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eedfca-6b83-4e3c-954b-9b2595e10b73 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:57.223219 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:57.323420 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eedfca-6b83-4e3c-954b-9b2595e10b73 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:57.377729 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7d936-9a21-479a-94cd-867b6685eefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:57.378270 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7d936-9a21-479a-94cd-867b6685eefe None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:57.378548 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7d936-9a21-479a-94cd-867b6685eefe None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:57.378818 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7d936-9a21-479a-94cd-867b6685eefe None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:57.379501 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7d936-9a21-479a-94cd-867b6685eefe None admin] RBAC: Adding query filter params (name=member) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:57.379799 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7d936-9a21-479a-94cd-867b6685eefe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:57.381212 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7d936-9a21-479a-94cd-867b6685eefe None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:57.396057 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 180/340] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 9 11:05:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:57.402668 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930c7a2-88ed-4601-bd27-514e79f5e60d None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:57.484775 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7d936-9a21-479a-94cd-867b6685eefe None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:57.546911 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930c7a2-88ed-4601-bd27-514e79f5e60d None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:57.638046 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:57.639496 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f7d0f-6c4e-4efb-8332-71d64a2b9493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:57.639845 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f7d0f-6c4e-4efb-8332-71d64a2b9493 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:57.640150 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f7d0f-6c4e-4efb-8332-71d64a2b9493 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:57.640419 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f7d0f-6c4e-4efb-8332-71d64a2b9493 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:57.663088 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7d936-9a21-479a-94cd-867b6685eefe None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:57.714907 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8d823-5b51-47bc-b042-09f58e59f341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:57.715947 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8d823-5b51-47bc-b042-09f58e59f341 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:57.716494 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8d823-5b51-47bc-b042-09f58e59f341 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:57.717007 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8d823-5b51-47bc-b042-09f58e59f341 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:57.721625 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:57.732255 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8d823-5b51-47bc-b042-09f58e59f341 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:57.742005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-20a8d823-5b51-47bc-b042-09f58e59f341 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:05:57.742005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:57.742005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:57.742005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:57.742005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:57.742005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:57.742005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:57.742005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:57.742005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:57.742005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:57.742005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:57.742005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:57.742005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:57.742005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:57.742005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:57.742005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:57.742964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:57.742964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:57.742964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:57.742964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:57.742964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:57.742964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:57.742964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:57.742964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:57.742964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:57.742964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:57.742964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:57.742964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:57.742964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:57.742964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:57.742964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:57.742964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:57.743748 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:57.743748 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:57.743748 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:57.743748 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:57.743748 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:57.743748 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:57.743748 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:57.743748 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:57.743748 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:57.743748 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:57.743748 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:05:57.743748 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:05:57.745962 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 181/341] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 9 11:05:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:05:57.750616 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f7d0f-6c4e-4efb-8332-71d64a2b9493 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:57.752143 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f7d0f-6c4e-4efb-8332-71d64a2b9493 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:57.752893 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8d823-5b51-47bc-b042-09f58e59f341 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:57.901748 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8d823-5b51-47bc-b042-09f58e59f341 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:57.910528 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 161/342] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:05:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:05:57.925545 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87811c70-39ee-49c5-b951-cce505167fe0 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:57.925857 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87811c70-39ee-49c5-b951-cce505167fe0 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:57.926110 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87811c70-39ee-49c5-b951-cce505167fe0 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:57.927699 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 162/343] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:57.934167 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87811c70-39ee-49c5-b951-cce505167fe0 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:57.954906 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7dd1e-33b4-4127-ad67-c5819b08ade7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:57.955529 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7dd1e-33b4-4127-ad67-c5819b08ade7 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:57.955810 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7dd1e-33b4-4127-ad67-c5819b08ade7 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:57.956136 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7dd1e-33b4-4127-ad67-c5819b08ade7 None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:57.956798 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7dd1e-33b4-4127-ad67-c5819b08ade7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:57.957094 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7dd1e-33b4-4127-ad67-c5819b08ade7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:57.958511 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7dd1e-33b4-4127-ad67-c5819b08ade7 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:57.971896 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 182/344] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:05:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:57.973218 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7116c-584d-4af7-9f2b-f2d6ac97716b None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:57.973526 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7116c-584d-4af7-9f2b-f2d6ac97716b None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:57.973797 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7116c-584d-4af7-9f2b-f2d6ac97716b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:57.995544 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:58.007008 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-95f7116c-584d-4af7-9f2b-f2d6ac97716b None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:58.008207 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-95f7116c-584d-4af7-9f2b-f2d6ac97716b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:58.074656 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:58.105989 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87811c70-39ee-49c5-b951-cce505167fe0 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:58.118237 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 183/345] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:58.118994 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7116c-584d-4af7-9f2b-f2d6ac97716b None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:58.179018 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33447384-f9df-4b96-9296-35b193341425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:58.179745 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33447384-f9df-4b96-9296-35b193341425 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:58.179863 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33447384-f9df-4b96-9296-35b193341425 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:58.180136 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33447384-f9df-4b96-9296-35b193341425 None admin] PATH_INFO: `/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:58.181446 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33447384-f9df-4b96-9296-35b193341425 None admin] RBAC: Authorizing `identity:get_project(project_id=b614dbb6ad10435abe1ffe4e9071d2e3)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:58.182908 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33447384-f9df-4b96-9296-35b193341425 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:58.184921 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 163/346] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:05:57 2022] GET /identity/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3 => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:05:58.190413 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adae81-77e8-40a3-9280-181dc5c0ecfb None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:58.190694 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adae81-77e8-40a3-9280-181dc5c0ecfb None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:58.190971 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adae81-77e8-40a3-9280-181dc5c0ecfb None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:58.192300 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 164/347] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:58.198264 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adae81-77e8-40a3-9280-181dc5c0ecfb None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:58.241081 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7116c-584d-4af7-9f2b-f2d6ac97716b None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:58.286852 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a351e87-a81f-47c1-8e36-4f43f3b460e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:58.287997 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a351e87-a81f-47c1-8e36-4f43f3b460e8 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:58.288494 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a351e87-a81f-47c1-8e36-4f43f3b460e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:58.289053 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a351e87-a81f-47c1-8e36-4f43f3b460e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:58.298134 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:58.334839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adae81-77e8-40a3-9280-181dc5c0ecfb None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:58.381937 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704b87b-ad7a-4ff1-a485-41b33bb5ae9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:58.382967 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704b87b-ad7a-4ff1-a485-41b33bb5ae9f None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:58.383317 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a351e87-a81f-47c1-8e36-4f43f3b460e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:58.383441 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704b87b-ad7a-4ff1-a485-41b33bb5ae9f None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:58.383762 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704b87b-ad7a-4ff1-a485-41b33bb5ae9f None admin] PATH_INFO: `/v3/groups/65e62498cb20482ebe9c3411ceffa002` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:58.385118 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a351e87-a81f-47c1-8e36-4f43f3b460e8 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:58.391930 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704b87b-ad7a-4ff1-a485-41b33bb5ae9f None admin] RBAC: Authorizing `identity:get_group(group_id=65e62498cb20482ebe9c3411ceffa002)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:58.393445 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704b87b-ad7a-4ff1-a485-41b33bb5ae9f None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:58.395425 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 165/348] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 9 11:05:58 2022] GET /identity/v3/groups/65e62498cb20482ebe9c3411ceffa002 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:58.397930 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335e699-8f9b-4666-8623-b84c533bc03b None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:58.398436 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335e699-8f9b-4666-8623-b84c533bc03b None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:58.398940 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335e699-8f9b-4666-8623-b84c533bc03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:58.430549 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-c335e699-8f9b-4666-8623-b84c533bc03b None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:58.432461 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-c335e699-8f9b-4666-8623-b84c533bc03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:58.438414 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:58.534278 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 166/349] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:58.535745 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649ce29-da0f-4211-8e41-16be10490f1c None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:58.536127 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649ce29-da0f-4211-8e41-16be10490f1c None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:58.536475 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 184/350] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:05:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:05:58.536598 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649ce29-da0f-4211-8e41-16be10490f1c None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:58.537633 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a351e87-a81f-47c1-8e36-4f43f3b460e8 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:58.538108 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 167/351] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:58.543231 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649ce29-da0f-4211-8e41-16be10490f1c None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:58.605671 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:58.662458 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a351e87-a81f-47c1-8e36-4f43f3b460e8 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:58.675230 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649ce29-da0f-4211-8e41-16be10490f1c None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:58.707317 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fd65c-d839-4558-ac02-11f832b9c3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:58.707960 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fd65c-d839-4558-ac02-11f832b9c3e6 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:58.708394 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fd65c-d839-4558-ac02-11f832b9c3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:58.708672 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fd65c-d839-4558-ac02-11f832b9c3e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:58.709754 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128fd65c-d839-4558-ac02-11f832b9c3e6 None admin] RBAC: Adding query filter params (group.id=65e62498cb20482ebe9c3411ceffa002, role.id=cf09a959c760483db0dff049f84e5482, scope.project.id=b614dbb6ad10435abe1ffe4e9071d2e3) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:58.710368 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128fd65c-d839-4558-ac02-11f832b9c3e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:58.712062 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128fd65c-d839-4558-ac02-11f832b9c3e6 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:58.714564 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b9492-cad8-46bd-99fa-7f818dd3e255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:58.715294 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b9492-cad8-46bd-99fa-7f818dd3e255 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:58.715691 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b9492-cad8-46bd-99fa-7f818dd3e255 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:58.716052 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b9492-cad8-46bd-99fa-7f818dd3e255 None admin] PATH_INFO: `/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:58.717994 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b9492-cad8-46bd-99fa-7f818dd3e255 None admin] RBAC: Authorizing `identity:get_project(project_id=b614dbb6ad10435abe1ffe4e9071d2e3)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:58.719029 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 185/352] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 9 11:05:58 2022] GET /identity/v3/role_assignments?group.id=65e62498cb20482ebe9c3411ceffa002&scope.project.id=b614dbb6ad10435abe1ffe4e9071d2e3&role.id=cf09a959c760483db0dff049f84e5482 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:58.719985 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b9492-cad8-46bd-99fa-7f818dd3e255 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:58.720460 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e873f8-cadf-4764-b8c9-3b4011203722 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:58.720745 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e873f8-cadf-4764-b8c9-3b4011203722 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:58.721021 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e873f8-cadf-4764-b8c9-3b4011203722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:58.722355 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 168/353] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:05:58 2022] GET /identity/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:58.723269 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b9492-cad8-46bd-99fa-7f818dd3e255 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:58.749121 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:58.762368 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-37e873f8-cadf-4764-b8c9-3b4011203722 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:58.763635 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-37e873f8-cadf-4764-b8c9-3b4011203722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:58.895550 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b9492-cad8-46bd-99fa-7f818dd3e255 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:58.945238 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fc5b8-7c0f-4343-8a05-9f19b024ab89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:58.946274 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fc5b8-7c0f-4343-8a05-9f19b024ab89 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:58.946605 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fc5b8-7c0f-4343-8a05-9f19b024ab89 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:58.946872 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fc5b8-7c0f-4343-8a05-9f19b024ab89 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:58.954910 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 186/354] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:58.956116 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e873f8-cadf-4764-b8c9-3b4011203722 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:58.960587 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493fc5b8-7c0f-4343-8a05-9f19b024ab89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:58.966861 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-493fc5b8-7c0f-4343-8a05-9f19b024ab89 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:05:58.966861 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:58.966861 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:58.966861 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:58.966861 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:58.966861 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:58.966861 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:58.966861 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:58.966861 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:58.966861 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:58.966861 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:58.966861 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:58.966861 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:58.966861 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:58.966861 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:58.966861 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:58.968348 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:58.968348 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:58.968348 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:58.968348 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:58.968348 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:58.968348 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:58.968348 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:58.968348 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:58.968348 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:58.968348 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:58.968348 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:58.968348 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:58.968348 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:58.968348 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:58.968348 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:58.968348 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:58.969167 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:58.969167 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:58.969167 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:58.969167 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:58.969167 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:58.969167 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:58.969167 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:58.969167 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:58.969167 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:58.969167 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:58.969167 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:05:58.969167 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:05:58.970962 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 169/355] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:05:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:05:58.971666 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fc5b8-7c0f-4343-8a05-9f19b024ab89 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:59.003507 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:59.089098 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e873f8-cadf-4764-b8c9-3b4011203722 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:59.126139 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd54584-a59b-43d0-852f-266a453b7051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:59.127199 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd54584-a59b-43d0-852f-266a453b7051 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:59.127721 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd54584-a59b-43d0-852f-266a453b7051 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:59.128203 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd54584-a59b-43d0-852f-266a453b7051 None admin] PATH_INFO: `/v3/groups/65e62498cb20482ebe9c3411ceffa002` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:59.129679 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd54584-a59b-43d0-852f-266a453b7051 None admin] RBAC: Authorizing `identity:get_group(group_id=65e62498cb20482ebe9c3411ceffa002)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:59.130134 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:59.132316 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd54584-a59b-43d0-852f-266a453b7051 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:59.134401 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 187/356] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 9 11:05:58 2022] GET /identity/v3/groups/65e62498cb20482ebe9c3411ceffa002 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:59.135522 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd54584-a59b-43d0-852f-266a453b7051 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:59.207424 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fc5b8-7c0f-4343-8a05-9f19b024ab89 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:59.247342 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd54584-a59b-43d0-852f-266a453b7051 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:59.250622 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:59.277417 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f3888e-3e8a-441d-ba0b-ecb6b3723957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:59.278218 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3888e-3e8a-441d-ba0b-ecb6b3723957 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:59.278539 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3888e-3e8a-441d-ba0b-ecb6b3723957 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:59.278837 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3888e-3e8a-441d-ba0b-ecb6b3723957 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:59.290379 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77f0fb-e46e-4d18-b6a7-c1399b05f211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:59.290979 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f3888e-3e8a-441d-ba0b-ecb6b3723957 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:59.291563 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77f0fb-e46e-4d18-b6a7-c1399b05f211 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:59.292078 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77f0fb-e46e-4d18-b6a7-c1399b05f211 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:59.292565 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77f0fb-e46e-4d18-b6a7-c1399b05f211 None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:59.293440 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77f0fb-e46e-4d18-b6a7-c1399b05f211 None admin] RBAC: Adding query filter params (name=member) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:59.293946 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77f0fb-e46e-4d18-b6a7-c1399b05f211 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:59.296391 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77f0fb-e46e-4d18-b6a7-c1399b05f211 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:59.296745 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-b9f3888e-3e8a-441d-ba0b-ecb6b3723957 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:05:59.296745 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:59.296745 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:59.296745 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:59.296745 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:59.296745 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:59.296745 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:59.296745 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:59.296745 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:59.296745 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:59.296745 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:59.296745 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:59.296745 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:59.296745 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:59.296745 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:59.296745 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:59.297671 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:59.297671 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:59.297671 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:59.297671 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:59.297671 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:59.297671 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:59.297671 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:59.297671 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:59.297671 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:59.297671 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:59.297671 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:59.297671 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:59.297671 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:59.297671 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:59.297671 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:59.297671 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:59.298457 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:59.298457 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:59.298457 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:59.298457 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:59.298457 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:59.298457 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:59.298457 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:59.298457 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:59.298457 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:59.298457 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:59.298457 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:05:59.298457 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:05:59.298457 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 170/357] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 9 11:05:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:05:59.299136 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f3888e-3e8a-441d-ba0b-ecb6b3723957 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:59.310072 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 188/358] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 9 11:05:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:59.311942 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b251e-05cd-4f10-815a-59be27f8785e None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:59.312913 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b251e-05cd-4f10-815a-59be27f8785e None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:59.313443 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b251e-05cd-4f10-815a-59be27f8785e None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:59.314996 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 189/359] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:05:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:05:59.319072 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b251e-05cd-4f10-815a-59be27f8785e None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:59.440654 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f3888e-3e8a-441d-ba0b-ecb6b3723957 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:59.442138 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b251e-05cd-4f10-815a-59be27f8785e None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:59.477399 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:59.493050 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54327105-ab04-4a21-987e-eba1a0f8151c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:59.493439 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363eafc-38b6-47b6-b3e2-aebf304a1f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:59.493851 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54327105-ab04-4a21-987e-eba1a0f8151c None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:59.494022 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363eafc-38b6-47b6-b3e2-aebf304a1f01 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:59.494117 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54327105-ab04-4a21-987e-eba1a0f8151c None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:59.494275 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363eafc-38b6-47b6-b3e2-aebf304a1f01 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:59.494497 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54327105-ab04-4a21-987e-eba1a0f8151c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:59.494606 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363eafc-38b6-47b6-b3e2-aebf304a1f01 None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:59.495196 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363eafc-38b6-47b6-b3e2-aebf304a1f01 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:59.495289 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54327105-ab04-4a21-987e-eba1a0f8151c None admin] RBAC: Adding query filter params (group.id=65e62498cb20482ebe9c3411ceffa002, role.id=60e15fc9c58142f9907a923f384849cc, scope.project.id=b614dbb6ad10435abe1ffe4e9071d2e3) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:05:59.495496 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363eafc-38b6-47b6-b3e2-aebf304a1f01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:59.495589 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54327105-ab04-4a21-987e-eba1a0f8151c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:59.496855 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363eafc-38b6-47b6-b3e2-aebf304a1f01 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:59.496960 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54327105-ab04-4a21-987e-eba1a0f8151c None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:59.504349 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 171/360] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 9 11:05:59 2022] GET /identity/v3/role_assignments?group.id=65e62498cb20482ebe9c3411ceffa002&scope.project.id=b614dbb6ad10435abe1ffe4e9071d2e3&role.id=60e15fc9c58142f9907a923f384849cc => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:59.505527 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54327105-ab04-4a21-987e-eba1a0f8151c None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:59.510330 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 190/361] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:05:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:05:59.512563 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72096f8d-472c-4aba-8bf9-a001a6f2e390 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:59.512847 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72096f8d-472c-4aba-8bf9-a001a6f2e390 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:59.513117 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72096f8d-472c-4aba-8bf9-a001a6f2e390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:59.536311 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-72096f8d-472c-4aba-8bf9-a001a6f2e390 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:05:59.537650 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-72096f8d-472c-4aba-8bf9-a001a6f2e390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:05:59.561763 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:59.632587 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 191/362] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:05:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:05:59.633571 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72096f8d-472c-4aba-8bf9-a001a6f2e390 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:59.654101 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54327105-ab04-4a21-987e-eba1a0f8151c None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:59.708151 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e72d7-95f5-4da5-baba-9ced0feb3cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:59.709142 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e72d7-95f5-4da5-baba-9ced0feb3cd4 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:59.709649 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e72d7-95f5-4da5-baba-9ced0feb3cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:59.710141 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e72d7-95f5-4da5-baba-9ced0feb3cd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:59.839542 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72096f8d-472c-4aba-8bf9-a001a6f2e390 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:05:59.846478 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:05:59.870987 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e72d7-95f5-4da5-baba-9ced0feb3cd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:05:59.872524 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e72d7-95f5-4da5-baba-9ced0feb3cd4 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:05:59.886522 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc63b9-a6b1-47a3-a816-7b9eedc00152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:05:59.887506 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc63b9-a6b1-47a3-a816-7b9eedc00152 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:05:59.888062 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc63b9-a6b1-47a3-a816-7b9eedc00152 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:05:59.888566 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc63b9-a6b1-47a3-a816-7b9eedc00152 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:05:59.900284 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc63b9-a6b1-47a3-a816-7b9eedc00152 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:05:59.905835 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-cbdc63b9-a6b1-47a3-a816-7b9eedc00152 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:05:59.905835 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:05:59.905835 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:05:59.905835 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:05:59.905835 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:05:59.905835 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:05:59.905835 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:05:59.905835 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:05:59.905835 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:05:59.905835 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:05:59.905835 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:05:59.905835 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:05:59.905835 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:05:59.905835 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:05:59.905835 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:05:59.905835 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:05:59.906725 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:05:59.906725 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:05:59.906725 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:05:59.906725 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:05:59.906725 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:05:59.906725 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:05:59.906725 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:05:59.906725 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:05:59.906725 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:05:59.906725 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:05:59.906725 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:05:59.906725 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:05:59.906725 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:05:59.906725 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:05:59.906725 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:05:59.906725 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:05:59.907521 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:05:59.907521 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:05:59.907521 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:05:59.907521 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:05:59.907521 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:05:59.907521 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:05:59.907521 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:05:59.907521 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:05:59.907521 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:05:59.907521 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:05:59.907521 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:05:59.907521 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:05:59.909797 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 192/363] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:05:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:05:59.910985 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc63b9-a6b1-47a3-a816-7b9eedc00152 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:05:59.928216 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:00.029083 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc63b9-a6b1-47a3-a816-7b9eedc00152 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:00.069412 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90029fdf-6045-45ff-b432-92579a4458fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:00.070027 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90029fdf-6045-45ff-b432-92579a4458fe None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:00.070310 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90029fdf-6045-45ff-b432-92579a4458fe None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:00.070575 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90029fdf-6045-45ff-b432-92579a4458fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:00.079214 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 172/364] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:05:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:06:00.080895 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e72d7-95f5-4da5-baba-9ced0feb3cd4 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:00.154926 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90029fdf-6045-45ff-b432-92579a4458fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:00.156867 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90029fdf-6045-45ff-b432-92579a4458fe None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:00.179747 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:00.205955 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:00.219409 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e72d7-95f5-4da5-baba-9ced0feb3cd4 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:00.263007 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ca7a1-d4c2-45bd-826e-58fa932501ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:00.264037 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ca7a1-d4c2-45bd-826e-58fa932501ea None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:00.264506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ca7a1-d4c2-45bd-826e-58fa932501ea None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:00.264992 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ca7a1-d4c2-45bd-826e-58fa932501ea None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:00.265877 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ca7a1-d4c2-45bd-826e-58fa932501ea None admin] RBAC: Adding query filter params (name=reader) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:00.266387 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ca7a1-d4c2-45bd-826e-58fa932501ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:00.268041 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ca7a1-d4c2-45bd-826e-58fa932501ea None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:00.280097 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 173/365] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 9 11:06:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:00.281220 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ca7a1-d4c2-45bd-826e-58fa932501ea None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:00.302749 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 193/366] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:05:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:06:00.303671 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90029fdf-6045-45ff-b432-92579a4458fe None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:00.392390 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ca7a1-d4c2-45bd-826e-58fa932501ea None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:00.428859 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90029fdf-6045-45ff-b432-92579a4458fe None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:00.433226 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650929f1-f3b7-4a54-8cba-27c0fac365b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:00.433935 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650929f1-f3b7-4a54-8cba-27c0fac365b7 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:00.434209 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650929f1-f3b7-4a54-8cba-27c0fac365b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:00.434476 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650929f1-f3b7-4a54-8cba-27c0fac365b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:00.450384 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:00.452050 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650929f1-f3b7-4a54-8cba-27c0fac365b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:06:00.460063 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-650929f1-f3b7-4a54-8cba-27c0fac365b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:06:00.460063 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:00.460063 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:00.460063 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:00.460063 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:00.460063 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:00.460063 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:00.460063 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:00.460063 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:00.460063 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:00.460063 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:00.460063 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:00.460063 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:06:00.460063 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:06:00.460063 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:06:00.460063 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:06:00.461025 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:06:00.461025 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:06:00.461025 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:06:00.461025 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:06:00.461025 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:00.461025 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:00.461025 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:00.461025 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:00.461025 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:00.461025 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:00.461025 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:00.461025 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:00.461025 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:00.461025 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:00.461025 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:00.461025 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:00.461898 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:00.461898 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:00.461898 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:00.461898 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:00.461898 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:06:00.461898 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:06:00.461898 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:06:00.461898 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:06:00.461898 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:06:00.461898 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:06:00.461898 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:06:00.461898 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:00.461898 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 174/367] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 9 11:06:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:00.463074 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650929f1-f3b7-4a54-8cba-27c0fac365b7 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:00.481113 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d3020-bf9b-4f99-8c1c-da3b4be8767b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:00.481784 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d3020-bf9b-4f99-8c1c-da3b4be8767b None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:00.482060 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d3020-bf9b-4f99-8c1c-da3b4be8767b None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:00.482331 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d3020-bf9b-4f99-8c1c-da3b4be8767b None admin] PATH_INFO: `/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:00.484133 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:00.484272 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d3020-bf9b-4f99-8c1c-da3b4be8767b None admin] RBAC: Authorizing `identity:get_project(project_id=73f314874b5a4cbcb9f77b3c1c53b198)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:00.487907 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d3020-bf9b-4f99-8c1c-da3b4be8767b None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:00.490062 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 194/368] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:06:00 2022] GET /identity/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:00.491018 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d3020-bf9b-4f99-8c1c-da3b4be8767b None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:00.591859 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650929f1-f3b7-4a54-8cba-27c0fac365b7 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:00.611343 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d3020-bf9b-4f99-8c1c-da3b4be8767b None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:00.630782 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e79ba9-81ac-4ef0-90a0-72803038f980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:00.631894 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e79ba9-81ac-4ef0-90a0-72803038f980 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:00.632535 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e79ba9-81ac-4ef0-90a0-72803038f980 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:00.633054 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e79ba9-81ac-4ef0-90a0-72803038f980 None admin] PATH_INFO: `/v3/users/7b1c3c9bb91f4415ab625d7cc843100d` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:00.634526 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e79ba9-81ac-4ef0-90a0-72803038f980 None admin] RBAC: Authorizing `identity:get_user(user_id=7b1c3c9bb91f4415ab625d7cc843100d)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:00.636148 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e79ba9-81ac-4ef0-90a0-72803038f980 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:00.638177 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 175/369] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 9 11:06:00 2022] GET /identity/v3/users/7b1c3c9bb91f4415ab625d7cc843100d => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:00.640505 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e79ba9-81ac-4ef0-90a0-72803038f980 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:00.650383 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301845e-0937-4f51-bc47-763e8e477e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:00.651026 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301845e-0937-4f51-bc47-763e8e477e1b None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:00.651302 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301845e-0937-4f51-bc47-763e8e477e1b None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:00.651595 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301845e-0937-4f51-bc47-763e8e477e1b None admin] PATH_INFO: `/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:00.653159 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301845e-0937-4f51-bc47-763e8e477e1b None admin] RBAC: Authorizing `identity:get_project(project_id=73f314874b5a4cbcb9f77b3c1c53b198)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:00.655118 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301845e-0937-4f51-bc47-763e8e477e1b None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:00.657456 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 195/370] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:06:00 2022] GET /identity/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:00.658277 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301845e-0937-4f51-bc47-763e8e477e1b None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:00.714959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:00.748034 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:00.771703 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e79ba9-81ac-4ef0-90a0-72803038f980 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:00.773246 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301845e-0937-4f51-bc47-763e8e477e1b None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:00.810307 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6024fe-5940-440e-aba3-4b1c10c28f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:00.811753 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6024fe-5940-440e-aba3-4b1c10c28f19 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:00.812230 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6024fe-5940-440e-aba3-4b1c10c28f19 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:00.812983 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6024fe-5940-440e-aba3-4b1c10c28f19 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:00.813114 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ffc366-0fec-455f-b680-03e504ccedc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:00.815401 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffc366-0fec-455f-b680-03e504ccedc8 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:00.815401 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffc366-0fec-455f-b680-03e504ccedc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:00.815401 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffc366-0fec-455f-b680-03e504ccedc8 None admin] PATH_INFO: `/v3/groups/65e62498cb20482ebe9c3411ceffa002` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:00.818686 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ffc366-0fec-455f-b680-03e504ccedc8 None admin] RBAC: Authorizing `identity:get_group(group_id=65e62498cb20482ebe9c3411ceffa002)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:00.818981 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6024fe-5940-440e-aba3-4b1c10c28f19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:00.819491 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6024fe-5940-440e-aba3-4b1c10c28f19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:00.819692 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ffc366-0fec-455f-b680-03e504ccedc8 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:00.821362 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6024fe-5940-440e-aba3-4b1c10c28f19 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:00.821624 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 196/371] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 9 11:06:00 2022] GET /identity/v3/groups/65e62498cb20482ebe9c3411ceffa002 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:00.822494 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ffc366-0fec-455f-b680-03e504ccedc8 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:00.833117 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 176/372] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:06:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:00.834483 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6024fe-5940-440e-aba3-4b1c10c28f19 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:00.943352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ffc366-0fec-455f-b680-03e504ccedc8 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:00.960251 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6024fe-5940-440e-aba3-4b1c10c28f19 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:00.964223 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:00.985363 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bca823-93fe-44a7-a0c0-374e8cb5dfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:00.985889 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bca823-93fe-44a7-a0c0-374e8cb5dfb4 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:00.986163 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bca823-93fe-44a7-a0c0-374e8cb5dfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:00.986432 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bca823-93fe-44a7-a0c0-374e8cb5dfb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:00.987148 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bca823-93fe-44a7-a0c0-374e8cb5dfb4 None admin] RBAC: Adding query filter params (role.id=47e69ff304f7450a8a1810bd5b95b1f2, user.id=7b1c3c9bb91f4415ab625d7cc843100d, scope.system=all) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:00.987448 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bca823-93fe-44a7-a0c0-374e8cb5dfb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:00.989026 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bca823-93fe-44a7-a0c0-374e8cb5dfb4 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:01.003940 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 197/373] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Sep 9 11:06:00 2022] GET /identity/v3/role_assignments?user.id=7b1c3c9bb91f4415ab625d7cc843100d&scope.system=all&role.id=47e69ff304f7450a8a1810bd5b95b1f2 => generated 510 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:01.004953 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bca823-93fe-44a7-a0c0-374e8cb5dfb4 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:01.005746 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b362ced-634a-4bf6-b97d-8e5402be33b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:01.006638 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b362ced-634a-4bf6-b97d-8e5402be33b5 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:01.007120 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b362ced-634a-4bf6-b97d-8e5402be33b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:01.007716 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b362ced-634a-4bf6-b97d-8e5402be33b5 None admin] PATH_INFO: `/v3/groups/65e62498cb20482ebe9c3411ceffa002` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:01.009269 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b362ced-634a-4bf6-b97d-8e5402be33b5 None admin] RBAC: Authorizing `identity:get_group(group_id=65e62498cb20482ebe9c3411ceffa002)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:01.011033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b362ced-634a-4bf6-b97d-8e5402be33b5 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:01.013390 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 177/374] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 9 11:06:00 2022] GET /identity/v3/groups/65e62498cb20482ebe9c3411ceffa002 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:01.014668 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b362ced-634a-4bf6-b97d-8e5402be33b5 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:01.032969 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:01.129834 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bca823-93fe-44a7-a0c0-374e8cb5dfb4 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:01.145052 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b362ced-634a-4bf6-b97d-8e5402be33b5 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:01.172885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791d71c-1844-4bb5-a929-d19c43c1c54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:01.173532 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791d71c-1844-4bb5-a929-d19c43c1c54a None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:01.173809 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791d71c-1844-4bb5-a929-d19c43c1c54a None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:01.174077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791d71c-1844-4bb5-a929-d19c43c1c54a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:01.174856 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791d71c-1844-4bb5-a929-d19c43c1c54a None admin] RBAC: Adding query filter params (group.id=65e62498cb20482ebe9c3411ceffa002, role.id=cf09a959c760483db0dff049f84e5482, scope.project.id=73f314874b5a4cbcb9f77b3c1c53b198) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:01.175163 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791d71c-1844-4bb5-a929-d19c43c1c54a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:01.176750 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791d71c-1844-4bb5-a929-d19c43c1c54a None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:01.184014 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 198/375] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 9 11:06:01 2022] GET /identity/v3/role_assignments?group.id=65e62498cb20482ebe9c3411ceffa002&scope.project.id=73f314874b5a4cbcb9f77b3c1c53b198&role.id=cf09a959c760483db0dff049f84e5482 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:01.184965 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791d71c-1844-4bb5-a929-d19c43c1c54a None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:01.198487 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10291ec1-b16e-406a-86ea-367f5d09cf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:01.199556 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10291ec1-b16e-406a-86ea-367f5d09cf75 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:01.200039 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10291ec1-b16e-406a-86ea-367f5d09cf75 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:01.200505 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10291ec1-b16e-406a-86ea-367f5d09cf75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:01.237535 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:01.298066 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10291ec1-b16e-406a-86ea-367f5d09cf75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:01.300318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10291ec1-b16e-406a-86ea-367f5d09cf75 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:01.316942 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791d71c-1844-4bb5-a929-d19c43c1c54a None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:01.321552 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:01.358951 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84482e56-dc3a-4883-bdd9-4db1b69de63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:01.359621 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84482e56-dc3a-4883-bdd9-4db1b69de63b None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:01.359904 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84482e56-dc3a-4883-bdd9-4db1b69de63b None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:01.360175 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84482e56-dc3a-4883-bdd9-4db1b69de63b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:01.361010 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84482e56-dc3a-4883-bdd9-4db1b69de63b None admin] RBAC: Adding query filter params (group.id=65e62498cb20482ebe9c3411ceffa002, role.id=60e15fc9c58142f9907a923f384849cc, scope.project.id=73f314874b5a4cbcb9f77b3c1c53b198) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:01.361348 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84482e56-dc3a-4883-bdd9-4db1b69de63b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:01.362779 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84482e56-dc3a-4883-bdd9-4db1b69de63b None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:01.370295 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 199/376] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 9 11:06:01 2022] GET /identity/v3/role_assignments?group.id=65e62498cb20482ebe9c3411ceffa002&scope.project.id=73f314874b5a4cbcb9f77b3c1c53b198&role.id=60e15fc9c58142f9907a923f384849cc => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:01.439612 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 178/377] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:06:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:06:01.445833 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84482e56-dc3a-4883-bdd9-4db1b69de63b None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:01.599284 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84482e56-dc3a-4883-bdd9-4db1b69de63b None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:01.601064 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:01.640043 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa25043-c647-4df4-9e06-3e6d4c751498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:01.640812 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa25043-c647-4df4-9e06-3e6d4c751498 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:01.641141 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa25043-c647-4df4-9e06-3e6d4c751498 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:01.641451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa25043-c647-4df4-9e06-3e6d4c751498 None admin] PATH_INFO: `/v3/projects/8b0f23b110ec4b0cbf3d045893105ca2` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:01.642612 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa25043-c647-4df4-9e06-3e6d4c751498 None admin] RBAC: Authorizing `identity:get_project(project_id=8b0f23b110ec4b0cbf3d045893105ca2)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:01.644130 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa25043-c647-4df4-9e06-3e6d4c751498 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:01.647104 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 200/378] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:06:01 2022] GET /identity/v3/projects/8b0f23b110ec4b0cbf3d045893105ca2 => generated 344 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:01.651816 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10291ec1-b16e-406a-86ea-367f5d09cf75 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:01.769830 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10291ec1-b16e-406a-86ea-367f5d09cf75 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:01.784662 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:01.808576 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75827f55-2c91-4962-8f1e-cc789b8cab21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:01.809219 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75827f55-2c91-4962-8f1e-cc789b8cab21 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:01.809522 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75827f55-2c91-4962-8f1e-cc789b8cab21 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:01.809794 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75827f55-2c91-4962-8f1e-cc789b8cab21 None admin] PATH_INFO: `/v3/groups/dea38cc8b8d143b5bb3c63867d9b21f4` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:01.815814 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75827f55-2c91-4962-8f1e-cc789b8cab21 None admin] RBAC: Authorizing `identity:get_group(group_id=dea38cc8b8d143b5bb3c63867d9b21f4)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:01.817380 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75827f55-2c91-4962-8f1e-cc789b8cab21 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:01.821454 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 179/379] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 9 11:06:01 2022] GET /identity/v3/groups/dea38cc8b8d143b5bb3c63867d9b21f4 => generated 229 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:01.825397 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa25043-c647-4df4-9e06-3e6d4c751498 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:01.933423 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa25043-c647-4df4-9e06-3e6d4c751498 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:01.969566 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663eb3f-8fef-46b4-afd8-298338aac29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:01.970180 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663eb3f-8fef-46b4-afd8-298338aac29f None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:01.970461 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663eb3f-8fef-46b4-afd8-298338aac29f None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:01.970732 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663eb3f-8fef-46b4-afd8-298338aac29f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:01.971447 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663eb3f-8fef-46b4-afd8-298338aac29f None admin] RBAC: Adding query filter params (group.id=dea38cc8b8d143b5bb3c63867d9b21f4, role.id=b02ba8c157bf46f4a75cdab917db78db, scope.project.id=8b0f23b110ec4b0cbf3d045893105ca2) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:01.971751 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663eb3f-8fef-46b4-afd8-298338aac29f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:01.973165 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663eb3f-8fef-46b4-afd8-298338aac29f None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:01.979842 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 201/380] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 9 11:06:01 2022] GET /identity/v3/role_assignments?group.id=dea38cc8b8d143b5bb3c63867d9b21f4&scope.project.id=8b0f23b110ec4b0cbf3d045893105ca2&role.id=b02ba8c157bf46f4a75cdab917db78db => generated 260 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:02.129580 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6ca0f-c1b6-4b0d-a489-d5c1abfdb4ef None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:02.129909 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6ca0f-c1b6-4b0d-a489-d5c1abfdb4ef None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:02.130124 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6ca0f-c1b6-4b0d-a489-d5c1abfdb4ef None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:02.131655 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 180/381] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:02.151139 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5ee0f-87ee-451d-ae3f-6fdebe4e02c7 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:02.151443 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5ee0f-87ee-451d-ae3f-6fdebe4e02c7 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:02.151697 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5ee0f-87ee-451d-ae3f-6fdebe4e02c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:02.175828 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-29a5ee0f-87ee-451d-ae3f-6fdebe4e02c7 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:02.177215 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-29a5ee0f-87ee-451d-ae3f-6fdebe4e02c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:02.216922 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:02.268362 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 202/382] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:06:02.793778 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6ca0f-c1b6-4b0d-a489-d5c1abfdb4ef None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:02.839399 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c501af4-dc75-4c0d-8b9e-7b9821159e9b None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:02.839935 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c501af4-dc75-4c0d-8b9e-7b9821159e9b None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:02.839935 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c501af4-dc75-4c0d-8b9e-7b9821159e9b None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:02.841773 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 203/383] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:06:02.854276 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9383c1f-2adc-43d1-b7c3-693644392f87 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:02.854797 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9383c1f-2adc-43d1-b7c3-693644392f87 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:02.855205 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9383c1f-2adc-43d1-b7c3-693644392f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:02.878854 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-f9383c1f-2adc-43d1-b7c3-693644392f87 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:02.880378 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-f9383c1f-2adc-43d1-b7c3-693644392f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:02.945602 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6ca0f-c1b6-4b0d-a489-d5c1abfdb4ef None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:02.969873 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 204/384] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:06:03.011092 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17205eec-ee71-4b81-be6b-45df9fb4a877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:03.011729 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17205eec-ee71-4b81-be6b-45df9fb4a877 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:03.012005 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17205eec-ee71-4b81-be6b-45df9fb4a877 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:03.012273 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17205eec-ee71-4b81-be6b-45df9fb4a877 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:03.025584 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17205eec-ee71-4b81-be6b-45df9fb4a877 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:06:03.030613 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-17205eec-ee71-4b81-be6b-45df9fb4a877 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:06:03.030613 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:03.030613 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:03.030613 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:03.030613 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:03.030613 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:03.030613 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:03.030613 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:03.030613 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:03.030613 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:03.030613 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:03.030613 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:03.030613 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:06:03.030613 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:06:03.030613 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:06:03.030613 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:06:03.031506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:06:03.031506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:06:03.031506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:06:03.031506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:06:03.031506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:03.031506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:03.031506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:03.031506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:03.031506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:03.031506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:03.031506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:03.031506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:03.031506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:03.031506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:03.031506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:03.031506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:03.032322 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:03.032322 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:03.032322 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:03.032322 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:03.032322 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:06:03.032322 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:06:03.032322 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:06:03.032322 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:06:03.032322 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:06:03.032322 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:06:03.032322 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:06:03.032322 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:03.032322 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 181/385] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:06:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:03.038191 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9383c1f-2adc-43d1-b7c3-693644392f87 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:03.165778 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:03.173501 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9383c1f-2adc-43d1-b7c3-693644392f87 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:03.214532 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d279d3cb-dcf1-4008-9846-539fe1c041b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:03.215202 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279d3cb-dcf1-4008-9846-539fe1c041b8 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:03.215488 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279d3cb-dcf1-4008-9846-539fe1c041b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:03.215768 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279d3cb-dcf1-4008-9846-539fe1c041b8 None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:03.216447 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d279d3cb-dcf1-4008-9846-539fe1c041b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:03.220138 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d279d3cb-dcf1-4008-9846-539fe1c041b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:03.220138 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d279d3cb-dcf1-4008-9846-539fe1c041b8 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:03.228581 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 205/386] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 9 11:06:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:03.234195 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17205eec-ee71-4b81-be6b-45df9fb4a877 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:03.300687 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:03.403597 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17205eec-ee71-4b81-be6b-45df9fb4a877 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:03.455141 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fce82-8885-48ee-8d7d-fa758c746081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:03.455682 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fce82-8885-48ee-8d7d-fa758c746081 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:03.455956 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fce82-8885-48ee-8d7d-fa758c746081 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:03.456225 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326fce82-8885-48ee-8d7d-fa758c746081 None admin] PATH_INFO: `/v3/groups/65e62498cb20482ebe9c3411ceffa002` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:03.457359 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326fce82-8885-48ee-8d7d-fa758c746081 None admin] RBAC: Authorizing `identity:get_group(group_id=65e62498cb20482ebe9c3411ceffa002)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:03.458795 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326fce82-8885-48ee-8d7d-fa758c746081 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:03.460655 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 182/387] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 9 11:06:03 2022] GET /identity/v3/groups/65e62498cb20482ebe9c3411ceffa002 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:03.465071 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d279d3cb-dcf1-4008-9846-539fe1c041b8 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:03.465927 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fce82-8885-48ee-8d7d-fa758c746081 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:03.610701 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d279d3cb-dcf1-4008-9846-539fe1c041b8 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:03.640814 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326fce82-8885-48ee-8d7d-fa758c746081 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:03.646264 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:03.648558 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ee1d0-60e2-40d3-96a4-95c7e60175be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:03.649405 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ee1d0-60e2-40d3-96a4-95c7e60175be None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:03.649683 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ee1d0-60e2-40d3-96a4-95c7e60175be None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:03.649952 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ee1d0-60e2-40d3-96a4-95c7e60175be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:03.661678 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ee1d0-60e2-40d3-96a4-95c7e60175be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:06:03.667044 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-cc4ee1d0-60e2-40d3-96a4-95c7e60175be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:06:03.667044 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:03.667044 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:03.667044 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:03.667044 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:03.667044 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:03.667044 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:03.667044 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:03.667044 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:03.667044 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:03.667044 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:03.667044 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:03.667044 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:06:03.667044 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:06:03.667044 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:06:03.667044 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:06:03.667922 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:06:03.667922 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:06:03.667922 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:06:03.667922 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:06:03.667922 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:03.667922 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:03.667922 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:03.667922 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:03.667922 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:03.667922 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:03.667922 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:03.667922 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:03.667922 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:03.667922 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:03.667922 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:03.667922 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:03.669670 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:03.669670 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:03.669670 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:03.669670 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:03.669670 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:06:03.669670 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:06:03.669670 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:06:03.669670 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:06:03.669670 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:06:03.669670 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:06:03.669670 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:06:03.669670 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:03.669670 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 206/388] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 9 11:06:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:03.675262 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ee1d0-60e2-40d3-96a4-95c7e60175be None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:03.707989 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54657f93-400b-49fd-bc3c-bb423d2dc6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:03.708540 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54657f93-400b-49fd-bc3c-bb423d2dc6d8 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:03.708815 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54657f93-400b-49fd-bc3c-bb423d2dc6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:03.709084 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54657f93-400b-49fd-bc3c-bb423d2dc6d8 None admin] PATH_INFO: `/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:03.710135 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:03.715561 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54657f93-400b-49fd-bc3c-bb423d2dc6d8 None admin] RBAC: Authorizing `identity:get_project(project_id=b614dbb6ad10435abe1ffe4e9071d2e3)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:03.717157 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54657f93-400b-49fd-bc3c-bb423d2dc6d8 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:03.719095 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 183/389] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:06:03 2022] GET /identity/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:06:03.724813 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54657f93-400b-49fd-bc3c-bb423d2dc6d8 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:03.817843 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ee1d0-60e2-40d3-96a4-95c7e60175be None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:03.856656 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe843c-56b9-4151-81c8-a8340a1c7095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:03.857359 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe843c-56b9-4151-81c8-a8340a1c7095 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:03.857605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe843c-56b9-4151-81c8-a8340a1c7095 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:03.857856 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe843c-56b9-4151-81c8-a8340a1c7095 None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:03.858527 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe843c-56b9-4151-81c8-a8340a1c7095 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:03.858826 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe843c-56b9-4151-81c8-a8340a1c7095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:03.860188 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe843c-56b9-4151-81c8-a8340a1c7095 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:03.870534 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 207/390] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:06:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:06:03.876559 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe843c-56b9-4151-81c8-a8340a1c7095 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:03.938410 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54657f93-400b-49fd-bc3c-bb423d2dc6d8 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:04.012985 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950c459-3a90-419f-b2d3-fc6f2137691a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:04.014611 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950c459-3a90-419f-b2d3-fc6f2137691a None admin] REQUEST_METHOD: `PUT` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:04.015081 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950c459-3a90-419f-b2d3-fc6f2137691a None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:04.015531 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950c459-3a90-419f-b2d3-fc6f2137691a None admin] PATH_INFO: `/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3/groups/65e62498cb20482ebe9c3411ceffa002/roles/cf09a959c760483db0dff049f84e5482` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:04.025857 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950c459-3a90-419f-b2d3-fc6f2137691a None admin] RBAC: Authorizing `identity:create_grant(project_id=b614dbb6ad10435abe1ffe4e9071d2e3, group_id=65e62498cb20482ebe9c3411ceffa002, role_id=cf09a959c760483db0dff049f84e5482)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:04.027613 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950c459-3a90-419f-b2d3-fc6f2137691a None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:04.032750 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe843c-56b9-4151-81c8-a8340a1c7095 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:04.036834 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:04.064001 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 184/391] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Sep 9 11:06:03 2022] PUT /identity/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3/groups/65e62498cb20482ebe9c3411ceffa002/roles/cf09a959c760483db0dff049f84e5482 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:06:04.082523 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854d8b9-744f-4554-a41d-06a133ffbfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:04.083259 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854d8b9-744f-4554-a41d-06a133ffbfcc None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:04.083540 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854d8b9-744f-4554-a41d-06a133ffbfcc None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:04.083816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854d8b9-744f-4554-a41d-06a133ffbfcc None admin] PATH_INFO: `/v3/groups/65e62498cb20482ebe9c3411ceffa002` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:04.086009 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854d8b9-744f-4554-a41d-06a133ffbfcc None admin] RBAC: Authorizing `identity:get_group(group_id=65e62498cb20482ebe9c3411ceffa002)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:04.087498 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854d8b9-744f-4554-a41d-06a133ffbfcc None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:04.089702 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 208/392] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 9 11:06:03 2022] GET /identity/v3/groups/65e62498cb20482ebe9c3411ceffa002 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:04.095705 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950c459-3a90-419f-b2d3-fc6f2137691a None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:04.149247 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:04.249023 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950c459-3a90-419f-b2d3-fc6f2137691a None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:04.300047 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452ec21-f737-42ee-a5bb-cabf7e43aee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:04.300707 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452ec21-f737-42ee-a5bb-cabf7e43aee6 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:04.300986 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452ec21-f737-42ee-a5bb-cabf7e43aee6 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:04.301338 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452ec21-f737-42ee-a5bb-cabf7e43aee6 None admin] PATH_INFO: `/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:04.302579 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2452ec21-f737-42ee-a5bb-cabf7e43aee6 None admin] RBAC: Authorizing `identity:get_project(project_id=b614dbb6ad10435abe1ffe4e9071d2e3)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:04.304063 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2452ec21-f737-42ee-a5bb-cabf7e43aee6 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:04.306160 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 185/393] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:06:04 2022] GET /identity/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:04.312232 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854d8b9-744f-4554-a41d-06a133ffbfcc None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:04.438616 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854d8b9-744f-4554-a41d-06a133ffbfcc None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:04.475338 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b14a9-9e5c-4402-b570-4dd092d765aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:04.476351 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b14a9-9e5c-4402-b570-4dd092d765aa None admin] REQUEST_METHOD: `PUT` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:04.476831 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b14a9-9e5c-4402-b570-4dd092d765aa None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:04.477356 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b14a9-9e5c-4402-b570-4dd092d765aa None admin] PATH_INFO: `/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3/groups/65e62498cb20482ebe9c3411ceffa002/roles/60e15fc9c58142f9907a923f384849cc` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:04.479711 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b14a9-9e5c-4402-b570-4dd092d765aa None admin] RBAC: Authorizing `identity:create_grant(project_id=b614dbb6ad10435abe1ffe4e9071d2e3, group_id=65e62498cb20482ebe9c3411ceffa002, role_id=60e15fc9c58142f9907a923f384849cc)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:04.481403 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b14a9-9e5c-4402-b570-4dd092d765aa None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:04.506046 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 209/394] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Sep 9 11:06:04 2022] PUT /identity/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3/groups/65e62498cb20482ebe9c3411ceffa002/roles/60e15fc9c58142f9907a923f384849cc => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:06:04.778384 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626928b1-57f6-44e2-91c9-68c109d647a5 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:04.778782 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626928b1-57f6-44e2-91c9-68c109d647a5 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:04.778957 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626928b1-57f6-44e2-91c9-68c109d647a5 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:04.780885 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 186/395] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:04.787106 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1e2dc-db3f-46f1-b141-4fe763ecfa97 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:04.787383 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1e2dc-db3f-46f1-b141-4fe763ecfa97 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:04.787683 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1e2dc-db3f-46f1-b141-4fe763ecfa97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:04.802836 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:04.809228 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-09e1e2dc-db3f-46f1-b141-4fe763ecfa97 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:04.810524 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-09e1e2dc-db3f-46f1-b141-4fe763ecfa97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:04.903671 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 210/396] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:06:04.998574 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9ef02-428c-4da5-966f-cbcecea824ca None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:04.999069 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9ef02-428c-4da5-966f-cbcecea824ca None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:04.999141 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9ef02-428c-4da5-966f-cbcecea824ca None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:05.000436 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 187/397] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:05.005812 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185353bf-4728-4a31-9f45-3e913b1c943e None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:05.006331 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185353bf-4728-4a31-9f45-3e913b1c943e None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:05.006821 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185353bf-4728-4a31-9f45-3e913b1c943e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:05.034689 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-185353bf-4728-4a31-9f45-3e913b1c943e None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:05.035802 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-185353bf-4728-4a31-9f45-3e913b1c943e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:05.120452 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 211/398] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:06:05.181978 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff969e1-4545-435b-a6e5-6612b6ba5a58 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:05.182619 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff969e1-4545-435b-a6e5-6612b6ba5a58 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:05.183082 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff969e1-4545-435b-a6e5-6612b6ba5a58 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:05.184865 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 188/399] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:05.190414 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0b759-654a-4347-8ab0-db812150263f None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:05.190701 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0b759-654a-4347-8ab0-db812150263f None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:05.190977 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0b759-654a-4347-8ab0-db812150263f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:05.214159 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-34c0b759-654a-4347-8ab0-db812150263f None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:05.215397 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-34c0b759-654a-4347-8ab0-db812150263f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:05.290341 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:05.306029 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 212/400] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:06:05.314283 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff969e1-4545-435b-a6e5-6612b6ba5a58 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:05.428902 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:05.432930 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff969e1-4545-435b-a6e5-6612b6ba5a58 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:05.481984 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d06ff-ca14-4689-b771-cf2664f0cc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:05.482654 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d06ff-ca14-4689-b771-cf2664f0cc3e None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:05.482933 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d06ff-ca14-4689-b771-cf2664f0cc3e None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:05.483202 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d06ff-ca14-4689-b771-cf2664f0cc3e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:05.494023 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d06ff-ca14-4689-b771-cf2664f0cc3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:06:05.499581 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-a98d06ff-ca14-4689-b771-cf2664f0cc3e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:06:05.499581 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:05.499581 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:05.499581 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:05.499581 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:05.499581 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:05.499581 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:05.499581 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:05.499581 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:05.499581 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:05.499581 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:05.499581 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:05.499581 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:06:05.499581 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:06:05.499581 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:06:05.499581 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:06:05.500509 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:06:05.500509 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:06:05.500509 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:06:05.500509 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:06:05.500509 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:05.500509 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:05.500509 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:05.500509 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:05.500509 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:05.500509 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:05.500509 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:05.500509 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:05.500509 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:05.500509 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:05.500509 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:05.500509 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:05.501313 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:05.501313 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:05.501313 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:05.501313 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:05.501313 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:06:05.501313 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:06:05.501313 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:06:05.501313 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:06:05.501313 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:06:05.501313 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:06:05.501313 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:06:05.501313 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:05.501313 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 189/401] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 9 11:06:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:05.508724 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0b759-654a-4347-8ab0-db812150263f None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:05.632211 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0b759-654a-4347-8ab0-db812150263f None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:05.658412 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d06ff-ca14-4689-b771-cf2664f0cc3e None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:05.678533 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a590f-52ea-46fd-b573-649e803cfffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:05.679206 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a590f-52ea-46fd-b573-649e803cfffa None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:05.679488 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a590f-52ea-46fd-b573-649e803cfffa None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:05.679758 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a590f-52ea-46fd-b573-649e803cfffa None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:05.680428 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a590f-52ea-46fd-b573-649e803cfffa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:05.680784 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a590f-52ea-46fd-b573-649e803cfffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:05.682348 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a590f-52ea-46fd-b573-649e803cfffa None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:05.697272 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 213/402] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:06:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:05.697272 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a590f-52ea-46fd-b573-649e803cfffa None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:05.762970 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:05.798302 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d06ff-ca14-4689-b771-cf2664f0cc3e None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:05.820788 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a590f-52ea-46fd-b573-649e803cfffa None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:05.842409 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef74027-cdaf-4be9-992f-48333d4206e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:05.843441 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef74027-cdaf-4be9-992f-48333d4206e8 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:05.843944 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef74027-cdaf-4be9-992f-48333d4206e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:05.844418 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef74027-cdaf-4be9-992f-48333d4206e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:05.859802 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef74027-cdaf-4be9-992f-48333d4206e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:06:05.860899 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466cf99-70b3-440f-b997-af859e9f7a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:05.861803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466cf99-70b3-440f-b997-af859e9f7a7d None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:05.862150 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466cf99-70b3-440f-b997-af859e9f7a7d None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:05.862514 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466cf99-70b3-440f-b997-af859e9f7a7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:05.867056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-eef74027-cdaf-4be9-992f-48333d4206e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:06:05.867056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:05.867056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:05.867056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:05.867056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:05.867056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:05.867056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:05.867056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:05.867056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:05.867056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:05.867056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:05.867056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:05.867056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:06:05.867056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:06:05.867056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:06:05.867056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:06:05.867959 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:06:05.867959 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:06:05.867959 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:06:05.867959 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:06:05.867959 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:05.867959 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:05.867959 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:05.867959 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:05.867959 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:05.867959 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:05.867959 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:05.867959 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:05.867959 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:05.867959 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:05.867959 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:05.867959 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:05.868755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:05.868755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:05.868755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:05.868755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:05.868755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:06:05.868755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:06:05.868755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:06:05.868755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:06:05.868755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:06:05.868755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:06:05.868755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:06:05.868755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:05.873398 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 190/403] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:06:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:06:05.873398 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef74027-cdaf-4be9-992f-48333d4206e8 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:05.883027 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e466cf99-70b3-440f-b997-af859e9f7a7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:06:05.890070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-e466cf99-70b3-440f-b997-af859e9f7a7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:06:05.890070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:05.890070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:05.890070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:05.890070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:05.890070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:05.890070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:05.890070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:05.890070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:05.890070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:05.890070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:05.890070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:05.890070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:06:05.890070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:06:05.890070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:06:05.890070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:06:05.890971 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:06:05.890971 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:06:05.890971 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:06:05.890971 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:06:05.890971 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:05.890971 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:05.890971 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:05.890971 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:05.890971 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:05.890971 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:05.890971 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:05.890971 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:05.890971 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:05.890971 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:05.890971 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:05.890971 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:05.891766 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:05.891766 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:05.891766 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:05.891766 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:05.891766 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:06:05.891766 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:06:05.891766 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:06:05.891766 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:06:05.891766 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:06:05.891766 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:06:05.891766 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:06:05.891766 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:05.894771 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 214/404] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 9 11:06:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:05.895745 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466cf99-70b3-440f-b997-af859e9f7a7d None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:05.910743 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:06.020410 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef74027-cdaf-4be9-992f-48333d4206e8 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:06.021087 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466cf99-70b3-440f-b997-af859e9f7a7d None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:06.042692 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:06.066143 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a17bc4-71d3-470e-bc5d-7d33d357e0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:06.067156 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a17bc4-71d3-470e-bc5d-7d33d357e0ce None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:06.067651 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a17bc4-71d3-470e-bc5d-7d33d357e0ce None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:06.068133 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a17bc4-71d3-470e-bc5d-7d33d357e0ce None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:06.069319 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a17bc4-71d3-470e-bc5d-7d33d357e0ce None admin] RBAC: Adding query filter params (name=member) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:06.069864 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a17bc4-71d3-470e-bc5d-7d33d357e0ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:06.071576 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a17bc4-71d3-470e-bc5d-7d33d357e0ce None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:06.076212 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccb869-d6b0-4c3b-a33a-a23a20ff0e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:06.076853 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccb869-d6b0-4c3b-a33a-a23a20ff0e9c None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:06.077128 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccb869-d6b0-4c3b-a33a-a23a20ff0e9c None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:06.077426 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccb869-d6b0-4c3b-a33a-a23a20ff0e9c None admin] PATH_INFO: `/v3/groups/65e62498cb20482ebe9c3411ceffa002` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:06.078590 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ccb869-d6b0-4c3b-a33a-a23a20ff0e9c None admin] RBAC: Authorizing `identity:get_group(group_id=65e62498cb20482ebe9c3411ceffa002)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:06.080976 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ccb869-d6b0-4c3b-a33a-a23a20ff0e9c None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:06.083048 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 191/406] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 9 11:06:05 2022] GET /identity/v3/groups/65e62498cb20482ebe9c3411ceffa002 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:06.083269 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 215/406] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 9 11:06:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:06.083839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccb869-d6b0-4c3b-a33a-a23a20ff0e9c None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:06.089964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a17bc4-71d3-470e-bc5d-7d33d357e0ce None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:06.204769 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a17bc4-71d3-470e-bc5d-7d33d357e0ce None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:06.208680 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:06.225940 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccb869-d6b0-4c3b-a33a-a23a20ff0e9c None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:06.265092 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22812b2-0072-4901-a910-1b9931eda72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:06.266061 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22812b2-0072-4901-a910-1b9931eda72c None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:06.266336 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22812b2-0072-4901-a910-1b9931eda72c None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:06.266600 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22812b2-0072-4901-a910-1b9931eda72c None admin] PATH_INFO: `/v3/groups/65e62498cb20482ebe9c3411ceffa002` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:06.268123 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22812b2-0072-4901-a910-1b9931eda72c None admin] RBAC: Authorizing `identity:get_group(group_id=65e62498cb20482ebe9c3411ceffa002)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:06.269582 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22812b2-0072-4901-a910-1b9931eda72c None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:06.271447 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 216/407] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 9 11:06:06 2022] GET /identity/v3/groups/65e62498cb20482ebe9c3411ceffa002 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:06:06.272282 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22812b2-0072-4901-a910-1b9931eda72c None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:06.273690 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afea9c1-c4c7-482b-8b6f-410904494051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:06.275483 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afea9c1-c4c7-482b-8b6f-410904494051 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:06.277526 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afea9c1-c4c7-482b-8b6f-410904494051 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:06.277695 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afea9c1-c4c7-482b-8b6f-410904494051 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:06.278356 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afea9c1-c4c7-482b-8b6f-410904494051 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:06.278658 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afea9c1-c4c7-482b-8b6f-410904494051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:06.280553 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afea9c1-c4c7-482b-8b6f-410904494051 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:06.295585 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 192/408] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:06:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:06.296338 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afea9c1-c4c7-482b-8b6f-410904494051 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:06.353506 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:06.416001 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afea9c1-c4c7-482b-8b6f-410904494051 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:06.433156 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22812b2-0072-4901-a910-1b9931eda72c None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:06.469720 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed3121-8304-4fd9-bcdd-36aa69343793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:06.470269 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed3121-8304-4fd9-bcdd-36aa69343793 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:06.470551 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed3121-8304-4fd9-bcdd-36aa69343793 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:06.470819 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed3121-8304-4fd9-bcdd-36aa69343793 None admin] PATH_INFO: `/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:06.471947 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727649f-9ae0-4567-a7ce-e4b2092f7a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:06.472072 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed3121-8304-4fd9-bcdd-36aa69343793 None admin] RBAC: Authorizing `identity:get_project(project_id=73f314874b5a4cbcb9f77b3c1c53b198)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:06.472895 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727649f-9ae0-4567-a7ce-e4b2092f7a43 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:06.473398 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727649f-9ae0-4567-a7ce-e4b2092f7a43 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:06.473595 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed3121-8304-4fd9-bcdd-36aa69343793 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:06.474065 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727649f-9ae0-4567-a7ce-e4b2092f7a43 None admin] PATH_INFO: `/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:06.479953 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 217/409] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:06:06 2022] GET /identity/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:06.480098 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727649f-9ae0-4567-a7ce-e4b2092f7a43 None admin] RBAC: Authorizing `identity:get_project(project_id=73f314874b5a4cbcb9f77b3c1c53b198)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:06.480176 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed3121-8304-4fd9-bcdd-36aa69343793 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:06.480268 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727649f-9ae0-4567-a7ce-e4b2092f7a43 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:06.481133 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 193/410] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:06:06 2022] GET /identity/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:06.481981 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727649f-9ae0-4567-a7ce-e4b2092f7a43 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:06.503560 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:06.602078 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727649f-9ae0-4567-a7ce-e4b2092f7a43 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:06.604517 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed3121-8304-4fd9-bcdd-36aa69343793 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:06.621817 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:06.641662 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bddae-6536-47ed-bd27-f2bd02b1d7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:06.642290 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bddae-6536-47ed-bd27-f2bd02b1d7d1 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:06.642566 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bddae-6536-47ed-bd27-f2bd02b1d7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:06.642834 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bddae-6536-47ed-bd27-f2bd02b1d7d1 None admin] PATH_INFO: `/v3/groups/dea38cc8b8d143b5bb3c63867d9b21f4` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:06.643939 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3bddae-6536-47ed-bd27-f2bd02b1d7d1 None admin] RBAC: Authorizing `identity:get_group(group_id=dea38cc8b8d143b5bb3c63867d9b21f4)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:06.644662 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c6a62-d05d-4378-92f6-49b30cfb9215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:06.645402 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3bddae-6536-47ed-bd27-f2bd02b1d7d1 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:06.645816 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c6a62-d05d-4378-92f6-49b30cfb9215 None admin] REQUEST_METHOD: `PUT` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:06.646309 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c6a62-d05d-4378-92f6-49b30cfb9215 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:06.646790 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c6a62-d05d-4378-92f6-49b30cfb9215 None admin] PATH_INFO: `/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198/groups/65e62498cb20482ebe9c3411ceffa002/roles/60e15fc9c58142f9907a923f384849cc` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:06.646969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 218/411] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 9 11:06:06 2022] GET /identity/v3/groups/dea38cc8b8d143b5bb3c63867d9b21f4 => generated 229 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:06.647672 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bddae-6536-47ed-bd27-f2bd02b1d7d1 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:06.649885 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c6a62-d05d-4378-92f6-49b30cfb9215 None admin] RBAC: Authorizing `identity:create_grant(project_id=73f314874b5a4cbcb9f77b3c1c53b198, group_id=65e62498cb20482ebe9c3411ceffa002, role_id=60e15fc9c58142f9907a923f384849cc)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:06.651544 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c6a62-d05d-4378-92f6-49b30cfb9215 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:06.670824 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 194/412] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Sep 9 11:06:06 2022] PUT /identity/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198/groups/65e62498cb20482ebe9c3411ceffa002/roles/60e15fc9c58142f9907a923f384849cc => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:06:06.673237 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c6a62-d05d-4378-92f6-49b30cfb9215 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:06.849660 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:06.871132 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bddae-6536-47ed-bd27-f2bd02b1d7d1 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:06.899273 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c6a62-d05d-4378-92f6-49b30cfb9215 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:06.946196 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08472609-566f-43f4-8821-7b719281e194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:06.946879 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08472609-566f-43f4-8821-7b719281e194 None admin] REQUEST_METHOD: `PUT` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:06.947156 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08472609-566f-43f4-8821-7b719281e194 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:06.947426 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08472609-566f-43f4-8821-7b719281e194 None admin] PATH_INFO: `/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198/groups/65e62498cb20482ebe9c3411ceffa002/roles/cf09a959c760483db0dff049f84e5482` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:06.950704 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08472609-566f-43f4-8821-7b719281e194 None admin] RBAC: Authorizing `identity:create_grant(project_id=73f314874b5a4cbcb9f77b3c1c53b198, group_id=65e62498cb20482ebe9c3411ceffa002, role_id=cf09a959c760483db0dff049f84e5482)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:06.952256 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08472609-566f-43f4-8821-7b719281e194 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:06.963326 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870379d3-82aa-4d04-b28b-84d314ee5057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:06.964288 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870379d3-82aa-4d04-b28b-84d314ee5057 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:06.964738 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870379d3-82aa-4d04-b28b-84d314ee5057 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:06.965482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870379d3-82aa-4d04-b28b-84d314ee5057 None admin] PATH_INFO: `/v3/projects/8b0f23b110ec4b0cbf3d045893105ca2` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:06.967671 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870379d3-82aa-4d04-b28b-84d314ee5057 None admin] RBAC: Authorizing `identity:get_project(project_id=8b0f23b110ec4b0cbf3d045893105ca2)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:06.968432 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 219/413] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Sep 9 11:06:06 2022] PUT /identity/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198/groups/65e62498cb20482ebe9c3411ceffa002/roles/cf09a959c760483db0dff049f84e5482 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:06:06.969726 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870379d3-82aa-4d04-b28b-84d314ee5057 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:06.969892 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bb5cf-b307-4af2-becd-a0c8fa067c4f None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:06.970292 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bb5cf-b307-4af2-becd-a0c8fa067c4f None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:06.970633 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bb5cf-b307-4af2-becd-a0c8fa067c4f None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:06.972094 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 220/414] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:06.972513 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 195/415] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:06:06 2022] GET /identity/v3/projects/8b0f23b110ec4b0cbf3d045893105ca2 => generated 344 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:06.978693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bb5cf-b307-4af2-becd-a0c8fa067c4f None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:06.989695 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad761a4e-2825-4ed8-a5db-010ee866fe9f None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:06.990332 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad761a4e-2825-4ed8-a5db-010ee866fe9f None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:06.990804 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad761a4e-2825-4ed8-a5db-010ee866fe9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:07.021683 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-ad761a4e-2825-4ed8-a5db-010ee866fe9f None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:07.024732 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-ad761a4e-2825-4ed8-a5db-010ee866fe9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:07.049413 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:07.133178 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bb5cf-b307-4af2-becd-a0c8fa067c4f None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:07.137905 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 196/416] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:06:07.179225 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa008c-ba1b-498d-b433-480526c0ae63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:07.179912 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa008c-ba1b-498d-b433-480526c0ae63 None admin] REQUEST_METHOD: `PUT` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:07.180189 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa008c-ba1b-498d-b433-480526c0ae63 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:07.180462 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa008c-ba1b-498d-b433-480526c0ae63 None admin] PATH_INFO: `/v3/projects/8b0f23b110ec4b0cbf3d045893105ca2/groups/dea38cc8b8d143b5bb3c63867d9b21f4/roles/b02ba8c157bf46f4a75cdab917db78db` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:07.182515 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa008c-ba1b-498d-b433-480526c0ae63 None admin] RBAC: Authorizing `identity:create_grant(project_id=8b0f23b110ec4b0cbf3d045893105ca2, group_id=dea38cc8b8d143b5bb3c63867d9b21f4, role_id=b02ba8c157bf46f4a75cdab917db78db)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:07.183966 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa008c-ba1b-498d-b433-480526c0ae63 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:07.210165 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 221/417] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Sep 9 11:06:06 2022] PUT /identity/v3/projects/8b0f23b110ec4b0cbf3d045893105ca2/groups/dea38cc8b8d143b5bb3c63867d9b21f4/roles/b02ba8c157bf46f4a75cdab917db78db => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:06:07.665189 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c74099-9188-4f61-b9e4-51ce20d725d0 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:07.665622 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c74099-9188-4f61-b9e4-51ce20d725d0 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:07.665803 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c74099-9188-4f61-b9e4-51ce20d725d0 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:07.667260 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 197/418] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:07.674196 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa008c-ba1b-498d-b433-480526c0ae63 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:07.675847 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ea7dc-d9c8-437a-a927-4024e46d886a None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:07.676132 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ea7dc-d9c8-437a-a927-4024e46d886a None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:07.676404 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ea7dc-d9c8-437a-a927-4024e46d886a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:07.697978 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-e68ea7dc-d9c8-437a-a927-4024e46d886a None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:07.699170 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-e68ea7dc-d9c8-437a-a927-4024e46d886a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:07.839541 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 198/419] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:06:07.844823 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa008c-ba1b-498d-b433-480526c0ae63 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:07.880365 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abd76c-ff22-475a-bf87-50ec8f0eeb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:07.881004 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abd76c-ff22-475a-bf87-50ec8f0eeb56 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:07.881303 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abd76c-ff22-475a-bf87-50ec8f0eeb56 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:07.881584 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abd76c-ff22-475a-bf87-50ec8f0eeb56 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:07.892214 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abd76c-ff22-475a-bf87-50ec8f0eeb56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:06:07.898232 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-a5abd76c-ff22-475a-bf87-50ec8f0eeb56 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:06:07.898232 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:07.898232 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:07.898232 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:07.898232 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:07.898232 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:07.898232 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:07.898232 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:07.898232 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:07.898232 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:07.898232 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:07.898232 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:07.898232 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:06:07.898232 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:06:07.898232 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:06:07.898232 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:06:07.899124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:06:07.899124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:06:07.899124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:06:07.899124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:06:07.899124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:07.899124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:07.899124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:07.899124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:07.899124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:07.899124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:07.899124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:07.899124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:07.899124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:07.899124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:07.899124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:07.899124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:07.900135 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:07.900135 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:07.900135 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:07.900135 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:07.900135 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:06:07.900135 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:06:07.900135 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:06:07.900135 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:06:07.900135 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:06:07.900135 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:06:07.900135 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:06:07.900135 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:07.900135 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 222/420] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:06:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:07.900135 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:07.910397 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ea7dc-d9c8-437a-a927-4024e46d886a None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:07.925901 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:08.063026 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ea7dc-d9c8-437a-a927-4024e46d886a None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:08.110129 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6711830-d45a-4675-b8e5-85bbcd690c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:08.110738 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6711830-d45a-4675-b8e5-85bbcd690c43 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:08.111015 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6711830-d45a-4675-b8e5-85bbcd690c43 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:08.111285 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6711830-d45a-4675-b8e5-85bbcd690c43 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:08.111949 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6711830-d45a-4675-b8e5-85bbcd690c43 None admin] RBAC: Adding query filter params (name=member) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:08.112247 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6711830-d45a-4675-b8e5-85bbcd690c43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:08.113650 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6711830-d45a-4675-b8e5-85bbcd690c43 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:08.122674 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 199/421] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 9 11:06:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:08.129098 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abd76c-ff22-475a-bf87-50ec8f0eeb56 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:08.289966 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abd76c-ff22-475a-bf87-50ec8f0eeb56 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:08.330600 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6711830-d45a-4675-b8e5-85bbcd690c43 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:08.341514 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e0ef9-ee21-4b97-9361-1b0f63babc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:08.343047 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e0ef9-ee21-4b97-9361-1b0f63babc05 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:08.343509 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e0ef9-ee21-4b97-9361-1b0f63babc05 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:08.343992 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e0ef9-ee21-4b97-9361-1b0f63babc05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:08.404833 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:08.454901 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:08.491461 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e0ef9-ee21-4b97-9361-1b0f63babc05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:08.493062 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e0ef9-ee21-4b97-9361-1b0f63babc05 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:08.531465 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6711830-d45a-4675-b8e5-85bbcd690c43 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:08.601245 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 223/422] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:06:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:06:08.607962 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e0ef9-ee21-4b97-9361-1b0f63babc05 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:08.632660 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57018684-8f27-454a-aedf-023add119dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:08.633707 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57018684-8f27-454a-aedf-023add119dd5 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:08.634196 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57018684-8f27-454a-aedf-023add119dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:08.634670 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57018684-8f27-454a-aedf-023add119dd5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:08.662153 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57018684-8f27-454a-aedf-023add119dd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:06:08.672750 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-57018684-8f27-454a-aedf-023add119dd5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:06:08.672750 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:08.672750 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:08.672750 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:08.672750 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:08.672750 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:08.672750 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:08.672750 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:08.672750 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:08.672750 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:08.672750 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:08.672750 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:08.672750 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:06:08.672750 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:06:08.672750 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:06:08.672750 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:06:08.673895 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:06:08.673895 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:06:08.673895 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:06:08.673895 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:06:08.673895 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:08.673895 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:08.673895 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:08.673895 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:08.673895 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:08.673895 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:08.673895 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:08.673895 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:08.673895 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:08.673895 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:08.673895 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:08.673895 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:08.674702 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:08.674702 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:08.674702 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:08.674702 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:08.674702 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:06:08.674702 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:06:08.674702 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:06:08.674702 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:06:08.674702 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:06:08.674702 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:06:08.674702 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:06:08.674702 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:08.677154 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 200/423] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 9 11:06:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:06:08.686996 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57018684-8f27-454a-aedf-023add119dd5 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:08.690328 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:08.713806 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e0ef9-ee21-4b97-9361-1b0f63babc05 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:08.757825 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e8a8a-86d1-4435-953a-8f1637ee48ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:08.758468 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e8a8a-86d1-4435-953a-8f1637ee48ef None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:08.758747 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e8a8a-86d1-4435-953a-8f1637ee48ef None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:08.759017 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e8a8a-86d1-4435-953a-8f1637ee48ef None admin] PATH_INFO: `/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:08.761771 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e8a8a-86d1-4435-953a-8f1637ee48ef None admin] RBAC: Authorizing `identity:get_project(project_id=b614dbb6ad10435abe1ffe4e9071d2e3)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:08.763218 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e8a8a-86d1-4435-953a-8f1637ee48ef None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:08.764933 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 224/424] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:06:08 2022] GET /identity/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:08.772083 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e8a8a-86d1-4435-953a-8f1637ee48ef None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:08.899049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e8a8a-86d1-4435-953a-8f1637ee48ef None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:08.935890 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:08.941759 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888aae7-a940-4d80-b643-083b3719cac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:08.942606 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888aae7-a940-4d80-b643-083b3719cac9 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:08.943236 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888aae7-a940-4d80-b643-083b3719cac9 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:08.943584 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888aae7-a940-4d80-b643-083b3719cac9 None admin] PATH_INFO: `/v3/groups/65e62498cb20482ebe9c3411ceffa002` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:08.945840 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888aae7-a940-4d80-b643-083b3719cac9 None admin] RBAC: Authorizing `identity:get_group(group_id=65e62498cb20482ebe9c3411ceffa002)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:08.949343 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888aae7-a940-4d80-b643-083b3719cac9 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:08.952109 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 225/425] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 9 11:06:08 2022] GET /identity/v3/groups/65e62498cb20482ebe9c3411ceffa002 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:08.954034 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57018684-8f27-454a-aedf-023add119dd5 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:08.961085 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888aae7-a940-4d80-b643-083b3719cac9 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:09.009401 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:09.023399 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801b575-c4d5-4765-818e-4a7f4fbbe732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:09.024100 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801b575-c4d5-4765-818e-4a7f4fbbe732 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:09.024445 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801b575-c4d5-4765-818e-4a7f4fbbe732 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:09.024712 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801b575-c4d5-4765-818e-4a7f4fbbe732 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:09.025400 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801b575-c4d5-4765-818e-4a7f4fbbe732 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:09.025692 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801b575-c4d5-4765-818e-4a7f4fbbe732 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:09.027063 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801b575-c4d5-4765-818e-4a7f4fbbe732 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:09.045488 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 201/426] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:06:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:09.049050 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801b575-c4d5-4765-818e-4a7f4fbbe732 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:09.156809 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888aae7-a940-4d80-b643-083b3719cac9 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:09.224844 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801b575-c4d5-4765-818e-4a7f4fbbe732 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:09.271558 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada09182-e338-4d01-be38-21eabe83b421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:09.272171 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada09182-e338-4d01-be38-21eabe83b421 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:09.272501 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada09182-e338-4d01-be38-21eabe83b421 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:09.272781 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada09182-e338-4d01-be38-21eabe83b421 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:09.286618 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef840739-816e-488d-a691-7f9355e73960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:09.287244 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef840739-816e-488d-a691-7f9355e73960 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:09.287524 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef840739-816e-488d-a691-7f9355e73960 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:09.287796 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef840739-816e-488d-a691-7f9355e73960 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:09.288521 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef840739-816e-488d-a691-7f9355e73960 None admin] RBAC: Adding query filter params (group.id=65e62498cb20482ebe9c3411ceffa002, role.id=cf09a959c760483db0dff049f84e5482, scope.project.id=b614dbb6ad10435abe1ffe4e9071d2e3) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:09.288823 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef840739-816e-488d-a691-7f9355e73960 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:09.290292 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef840739-816e-488d-a691-7f9355e73960 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:09.312136 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 226/427] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 9 11:06:08 2022] GET /identity/v3/role_assignments?group.id=65e62498cb20482ebe9c3411ceffa002&scope.project.id=b614dbb6ad10435abe1ffe4e9071d2e3&role.id=cf09a959c760483db0dff049f84e5482 => generated 611 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:09.350152 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:09.363703 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada09182-e338-4d01-be38-21eabe83b421 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:09.365204 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada09182-e338-4d01-be38-21eabe83b421 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:09.482806 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 202/428] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:06:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:06:09.490752 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef840739-816e-488d-a691-7f9355e73960 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:09.600073 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:09.611419 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1670f-a7ea-4d69-8f65-d015b885929d None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:09.611940 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1670f-a7ea-4d69-8f65-d015b885929d None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:09.612507 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1670f-a7ea-4d69-8f65-d015b885929d None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:09.615455 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 203/429] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:06:09.620383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5301bae-57c0-4bea-80e7-893ded27cff8 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:09.621057 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5301bae-57c0-4bea-80e7-893ded27cff8 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:09.621588 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5301bae-57c0-4bea-80e7-893ded27cff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:09.642052 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-b5301bae-57c0-4bea-80e7-893ded27cff8 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:09.643628 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-b5301bae-57c0-4bea-80e7-893ded27cff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:09.652315 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef840739-816e-488d-a691-7f9355e73960 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:09.694561 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da4779-6dd7-4f14-ac21-fd448a05dfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:09.695212 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da4779-6dd7-4f14-ac21-fd448a05dfe6 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:09.695495 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da4779-6dd7-4f14-ac21-fd448a05dfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:09.695771 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da4779-6dd7-4f14-ac21-fd448a05dfe6 None admin] PATH_INFO: `/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:09.696917 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da4779-6dd7-4f14-ac21-fd448a05dfe6 None admin] RBAC: Authorizing `identity:get_project(project_id=b614dbb6ad10435abe1ffe4e9071d2e3)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:09.698837 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da4779-6dd7-4f14-ac21-fd448a05dfe6 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:09.701952 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 227/430] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:06:09 2022] GET /identity/v3/projects/b614dbb6ad10435abe1ffe4e9071d2e3 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:09.708225 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da4779-6dd7-4f14-ac21-fd448a05dfe6 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:09.741566 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 204/431] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:06:09.839840 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da4779-6dd7-4f14-ac21-fd448a05dfe6 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:09.874086 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:09.881543 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c63473-e748-42b1-af6a-adce3fca05fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:09.882213 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c63473-e748-42b1-af6a-adce3fca05fa None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:09.882496 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c63473-e748-42b1-af6a-adce3fca05fa None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:09.882776 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c63473-e748-42b1-af6a-adce3fca05fa None admin] PATH_INFO: `/v3/groups/65e62498cb20482ebe9c3411ceffa002` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:09.884019 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c63473-e748-42b1-af6a-adce3fca05fa None admin] RBAC: Authorizing `identity:get_group(group_id=65e62498cb20482ebe9c3411ceffa002)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:09.885538 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c63473-e748-42b1-af6a-adce3fca05fa None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:09.887613 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 228/432] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 9 11:06:09 2022] GET /identity/v3/groups/65e62498cb20482ebe9c3411ceffa002 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:09.894169 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5301bae-57c0-4bea-80e7-893ded27cff8 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:09.917955 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:09.933548 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491605bc-d817-42c1-abc4-6a9da8f0f759 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:09.933850 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491605bc-d817-42c1-abc4-6a9da8f0f759 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:09.934098 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491605bc-d817-42c1-abc4-6a9da8f0f759 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:09.935755 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 229/433] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:06:09.942363 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b76b6-e9a0-401e-9bea-ec40050621c3 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:09.942650 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b76b6-e9a0-401e-9bea-ec40050621c3 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:09.942927 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b76b6-e9a0-401e-9bea-ec40050621c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:09.963167 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-830b76b6-e9a0-401e-9bea-ec40050621c3 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:09.964418 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-830b76b6-e9a0-401e-9bea-ec40050621c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:10.029253 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5301bae-57c0-4bea-80e7-893ded27cff8 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:10.050669 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 230/434] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:06:10.070407 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f7c56-81cb-4ff2-9be4-977d2a9642c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:10.071187 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f7c56-81cb-4ff2-9be4-977d2a9642c6 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:10.071571 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f7c56-81cb-4ff2-9be4-977d2a9642c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:10.071947 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f7c56-81cb-4ff2-9be4-977d2a9642c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:10.072776 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f7c56-81cb-4ff2-9be4-977d2a9642c6 None admin] RBAC: Adding query filter params (group.id=65e62498cb20482ebe9c3411ceffa002, role.id=60e15fc9c58142f9907a923f384849cc, scope.project.id=b614dbb6ad10435abe1ffe4e9071d2e3) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:10.073184 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f7c56-81cb-4ff2-9be4-977d2a9642c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:10.074798 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f7c56-81cb-4ff2-9be4-977d2a9642c6 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:10.082050 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 205/435] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 9 11:06:09 2022] GET /identity/v3/role_assignments?group.id=65e62498cb20482ebe9c3411ceffa002&scope.project.id=b614dbb6ad10435abe1ffe4e9071d2e3&role.id=60e15fc9c58142f9907a923f384849cc => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:10.188683 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b76b6-e9a0-401e-9bea-ec40050621c3 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:10.329446 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b76b6-e9a0-401e-9bea-ec40050621c3 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:10.364426 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:10.372030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f6a8e-c562-4a1f-ae8e-8e2a02fad87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:10.372698 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f6a8e-c562-4a1f-ae8e-8e2a02fad87f None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:10.373539 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f6a8e-c562-4a1f-ae8e-8e2a02fad87f None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:10.373812 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f6a8e-c562-4a1f-ae8e-8e2a02fad87f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:10.385980 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcba30-9b7c-45bc-8a4c-9b161a110ac0 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:10.386508 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcba30-9b7c-45bc-8a4c-9b161a110ac0 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:10.386508 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcba30-9b7c-45bc-8a4c-9b161a110ac0 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:10.387565 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f6a8e-c562-4a1f-ae8e-8e2a02fad87f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:06:10.388190 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 206/436] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:10.392630 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-f34f6a8e-c562-4a1f-ae8e-8e2a02fad87f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:06:10.392630 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:10.392630 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:10.392630 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:10.392630 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:10.392630 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:10.392630 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:10.392630 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:10.392630 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:10.392630 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:10.392630 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:10.392630 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:10.392630 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:06:10.392630 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:06:10.392630 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:06:10.392630 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:06:10.393652 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:06:10.393652 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:06:10.393652 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:06:10.393652 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:06:10.393652 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:10.393652 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:10.393652 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:10.393652 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:10.393652 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:10.393652 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:10.393652 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:10.393652 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:10.393652 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:10.393652 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:10.393652 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:10.393652 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:10.394451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:10.394451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:10.394451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:10.394451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:10.394451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:06:10.394451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:06:10.394451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:06:10.394451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:06:10.394451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:06:10.394451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:06:10.394451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:06:10.394451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:10.395911 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6f689-4a45-4f93-b5a0-2aab73c0ae33 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:10.395911 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6f689-4a45-4f93-b5a0-2aab73c0ae33 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:10.395911 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6f689-4a45-4f93-b5a0-2aab73c0ae33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:10.396301 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 231/437] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:06:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:10.399426 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f6a8e-c562-4a1f-ae8e-8e2a02fad87f None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:10.421852 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-73a6f689-4a45-4f93-b5a0-2aab73c0ae33 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:10.423248 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-73a6f689-4a45-4f93-b5a0-2aab73c0ae33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:10.518417 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 207/438] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:06:10.519266 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6f689-4a45-4f93-b5a0-2aab73c0ae33 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:10.527195 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f6a8e-c562-4a1f-ae8e-8e2a02fad87f None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:10.536906 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:10.570818 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298081af-07b1-41c3-82dd-b1abb7b47179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:10.571872 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298081af-07b1-41c3-82dd-b1abb7b47179 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:10.572335 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298081af-07b1-41c3-82dd-b1abb7b47179 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:10.572747 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298081af-07b1-41c3-82dd-b1abb7b47179 None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:10.573616 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298081af-07b1-41c3-82dd-b1abb7b47179 None admin] RBAC: Adding query filter params (name=member) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:10.573913 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298081af-07b1-41c3-82dd-b1abb7b47179 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:10.575867 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298081af-07b1-41c3-82dd-b1abb7b47179 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:10.587042 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 232/439] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 9 11:06:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:06:10.595454 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298081af-07b1-41c3-82dd-b1abb7b47179 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:10.650418 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6f689-4a45-4f93-b5a0-2aab73c0ae33 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:10.663970 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:10.692210 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21402a4b-465d-486c-b9ae-6b1824c3261f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:10.693151 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21402a4b-465d-486c-b9ae-6b1824c3261f None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:10.693460 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21402a4b-465d-486c-b9ae-6b1824c3261f None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:10.693725 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21402a4b-465d-486c-b9ae-6b1824c3261f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:10.708820 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21402a4b-465d-486c-b9ae-6b1824c3261f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:06:10.713195 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-21402a4b-465d-486c-b9ae-6b1824c3261f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:06:10.713195 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:10.713195 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:10.713195 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:10.713195 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:10.713195 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:10.713195 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:10.713195 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:10.713195 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:10.713195 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:10.713195 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:10.713195 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:10.713195 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:06:10.713195 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:06:10.713195 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:06:10.713195 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:06:10.714124 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:06:10.714124 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:06:10.714124 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:06:10.714124 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:06:10.714124 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:10.714124 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:10.714124 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:10.714124 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:10.714124 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:10.714124 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:10.714124 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:10.714124 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:10.714124 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:10.714124 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:10.714124 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:10.714124 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:10.714913 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:10.714913 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:10.714913 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:10.714913 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:10.714913 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:06:10.714913 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:06:10.714913 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:06:10.714913 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:06:10.714913 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:06:10.714913 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:06:10.714913 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:06:10.714913 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:10.714913 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 208/440] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 9 11:06:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:10.720691 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21402a4b-465d-486c-b9ae-6b1824c3261f None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:10.723446 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298081af-07b1-41c3-82dd-b1abb7b47179 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:10.762997 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787979e-8ca9-4740-a60b-a29c72e25328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:10.763696 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787979e-8ca9-4740-a60b-a29c72e25328 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:10.763972 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787979e-8ca9-4740-a60b-a29c72e25328 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:10.764241 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787979e-8ca9-4740-a60b-a29c72e25328 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:10.815070 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:10.840667 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21402a4b-465d-486c-b9ae-6b1824c3261f None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:10.844657 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787979e-8ca9-4740-a60b-a29c72e25328 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:10.846350 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787979e-8ca9-4740-a60b-a29c72e25328 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:10.876022 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce59f9-d8e9-48fb-9aba-00affe09eb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:10.876627 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce59f9-d8e9-48fb-9aba-00affe09eb36 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:10.876907 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce59f9-d8e9-48fb-9aba-00affe09eb36 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:10.877185 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce59f9-d8e9-48fb-9aba-00affe09eb36 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:10.877874 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce59f9-d8e9-48fb-9aba-00affe09eb36 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:10.878178 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce59f9-d8e9-48fb-9aba-00affe09eb36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:10.879570 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce59f9-d8e9-48fb-9aba-00affe09eb36 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:10.888264 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 209/441] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:06:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:10.889610 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce59f9-d8e9-48fb-9aba-00affe09eb36 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:10.900040 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:10.948729 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 233/442] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:06:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:06:10.949648 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787979e-8ca9-4740-a60b-a29c72e25328 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:10.992132 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce59f9-d8e9-48fb-9aba-00affe09eb36 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:11.025202 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c2355-6535-4288-9c2e-6b74d3e17a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:11.025894 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c2355-6535-4288-9c2e-6b74d3e17a23 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:11.026171 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c2355-6535-4288-9c2e-6b74d3e17a23 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:11.026442 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c2355-6535-4288-9c2e-6b74d3e17a23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:11.029601 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:11.038425 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c2355-6535-4288-9c2e-6b74d3e17a23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:06:11.043609 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-db6c2355-6535-4288-9c2e-6b74d3e17a23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:06:11.043609 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:11.043609 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:11.043609 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:11.043609 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:11.043609 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:11.043609 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:11.043609 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:11.043609 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:11.043609 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:11.043609 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:11.043609 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:11.043609 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:06:11.043609 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:06:11.043609 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:06:11.043609 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:06:11.045780 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:06:11.045780 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:06:11.045780 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:06:11.045780 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:06:11.045780 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:11.045780 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:11.045780 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:11.045780 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:11.045780 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:11.045780 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:11.045780 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:11.045780 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:11.045780 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:11.045780 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:11.045780 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:11.045780 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:11.047337 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:11.047337 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:11.047337 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:11.047337 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:11.047337 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:06:11.047337 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:06:11.047337 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:06:11.047337 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:06:11.047337 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:06:11.047337 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:06:11.047337 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:06:11.047337 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:11.047337 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 210/443] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 9 11:06:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:11.047337 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c2355-6535-4288-9c2e-6b74d3e17a23 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:11.055210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787979e-8ca9-4740-a60b-a29c72e25328 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:11.088802 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f548ee-7f3f-4fd9-9596-b78ff6ebab3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:11.089435 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f548ee-7f3f-4fd9-9596-b78ff6ebab3c None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:11.089712 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f548ee-7f3f-4fd9-9596-b78ff6ebab3c None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:11.089984 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f548ee-7f3f-4fd9-9596-b78ff6ebab3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:11.112122 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:11.148108 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c2355-6535-4288-9c2e-6b74d3e17a23 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:11.159213 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f548ee-7f3f-4fd9-9596-b78ff6ebab3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:11.160668 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f548ee-7f3f-4fd9-9596-b78ff6ebab3c None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:11.183093 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d00fb3-e840-44d4-a985-09a150264941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:11.183727 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d00fb3-e840-44d4-a985-09a150264941 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:11.184010 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d00fb3-e840-44d4-a985-09a150264941 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:11.184279 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d00fb3-e840-44d4-a985-09a150264941 None admin] PATH_INFO: `/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:11.185459 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d00fb3-e840-44d4-a985-09a150264941 None admin] RBAC: Authorizing `identity:get_project(project_id=73f314874b5a4cbcb9f77b3c1c53b198)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:11.186955 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d00fb3-e840-44d4-a985-09a150264941 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:11.188533 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 211/444] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:06:11 2022] GET /identity/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:11.189315 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d00fb3-e840-44d4-a985-09a150264941 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:11.257095 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:11.263292 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 234/445] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:06:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:06:11.264139 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f548ee-7f3f-4fd9-9596-b78ff6ebab3c None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:11.303969 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d00fb3-e840-44d4-a985-09a150264941 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:11.318776 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:11.340877 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41340270-0d06-4546-b75c-2a7353c567a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:11.341517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41340270-0d06-4546-b75c-2a7353c567a5 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:11.341799 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41340270-0d06-4546-b75c-2a7353c567a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:11.342148 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41340270-0d06-4546-b75c-2a7353c567a5 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:11.342807 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41340270-0d06-4546-b75c-2a7353c567a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:11.343102 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41340270-0d06-4546-b75c-2a7353c567a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:11.344487 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41340270-0d06-4546-b75c-2a7353c567a5 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:11.352656 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 212/446] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:06:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:11.353496 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41340270-0d06-4546-b75c-2a7353c567a5 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:11.370922 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f548ee-7f3f-4fd9-9596-b78ff6ebab3c None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:11.405938 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec292a-4d43-421f-acdc-8797b85dc7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:11.406568 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec292a-4d43-421f-acdc-8797b85dc7b6 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:11.406843 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec292a-4d43-421f-acdc-8797b85dc7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:11.407111 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec292a-4d43-421f-acdc-8797b85dc7b6 None admin] PATH_INFO: `/v3/groups/65e62498cb20482ebe9c3411ceffa002` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:11.408196 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec292a-4d43-421f-acdc-8797b85dc7b6 None admin] RBAC: Authorizing `identity:get_group(group_id=65e62498cb20482ebe9c3411ceffa002)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:11.409652 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec292a-4d43-421f-acdc-8797b85dc7b6 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:11.411666 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 235/447] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 9 11:06:11 2022] GET /identity/v3/groups/65e62498cb20482ebe9c3411ceffa002 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:11.414328 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec292a-4d43-421f-acdc-8797b85dc7b6 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:11.456504 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41340270-0d06-4546-b75c-2a7353c567a5 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:11.482779 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:11.492017 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e675b8-b5ca-4066-ac42-263be0f826b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:11.492648 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e675b8-b5ca-4066-ac42-263be0f826b3 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:11.492926 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e675b8-b5ca-4066-ac42-263be0f826b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:11.493198 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e675b8-b5ca-4066-ac42-263be0f826b3 None admin] PATH_INFO: `/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:11.494350 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e675b8-b5ca-4066-ac42-263be0f826b3 None admin] RBAC: Authorizing `identity:get_project(project_id=73f314874b5a4cbcb9f77b3c1c53b198)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:11.495781 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e675b8-b5ca-4066-ac42-263be0f826b3 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:11.497469 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 213/448] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:06:11 2022] GET /identity/v3/projects/73f314874b5a4cbcb9f77b3c1c53b198 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:11.498769 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e675b8-b5ca-4066-ac42-263be0f826b3 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:11.516424 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec292a-4d43-421f-acdc-8797b85dc7b6 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:11.536973 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:11.552311 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ea6f1-48da-45b9-9a26-b0ca89dbf158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:11.552920 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ea6f1-48da-45b9-9a26-b0ca89dbf158 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:11.553200 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ea6f1-48da-45b9-9a26-b0ca89dbf158 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:11.553509 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ea6f1-48da-45b9-9a26-b0ca89dbf158 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:11.599095 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e675b8-b5ca-4066-ac42-263be0f826b3 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:11.621882 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ea6f1-48da-45b9-9a26-b0ca89dbf158 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:11.623351 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ea6f1-48da-45b9-9a26-b0ca89dbf158 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:11.633729 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f935a-b0c4-406a-b5e4-ea09c2099c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:11.634336 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f935a-b0c4-406a-b5e4-ea09c2099c54 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:11.634617 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f935a-b0c4-406a-b5e4-ea09c2099c54 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:11.634887 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f935a-b0c4-406a-b5e4-ea09c2099c54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:11.635603 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f935a-b0c4-406a-b5e4-ea09c2099c54 None admin] RBAC: Adding query filter params (group.id=65e62498cb20482ebe9c3411ceffa002, role.id=cf09a959c760483db0dff049f84e5482, scope.project.id=73f314874b5a4cbcb9f77b3c1c53b198) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:11.635907 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f935a-b0c4-406a-b5e4-ea09c2099c54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:11.637338 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f935a-b0c4-406a-b5e4-ea09c2099c54 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:11.643176 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 214/449] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 9 11:06:11 2022] GET /identity/v3/role_assignments?group.id=65e62498cb20482ebe9c3411ceffa002&scope.project.id=73f314874b5a4cbcb9f77b3c1c53b198&role.id=cf09a959c760483db0dff049f84e5482 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:11.644145 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f935a-b0c4-406a-b5e4-ea09c2099c54 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:11.715218 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:11.731616 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 236/450] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:06:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:06:11.738739 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ea6f1-48da-45b9-9a26-b0ca89dbf158 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:11.764048 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:11.768308 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f935a-b0c4-406a-b5e4-ea09c2099c54 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:11.807807 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baec36c-8e4a-41c6-8da6-1d2d08748314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:11.808443 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baec36c-8e4a-41c6-8da6-1d2d08748314 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:11.808719 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baec36c-8e4a-41c6-8da6-1d2d08748314 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:11.808994 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baec36c-8e4a-41c6-8da6-1d2d08748314 None admin] PATH_INFO: `/v3/groups/65e62498cb20482ebe9c3411ceffa002` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:11.810229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baec36c-8e4a-41c6-8da6-1d2d08748314 None admin] RBAC: Authorizing `identity:get_group(group_id=65e62498cb20482ebe9c3411ceffa002)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:11.811702 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baec36c-8e4a-41c6-8da6-1d2d08748314 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:11.813523 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 215/451] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 9 11:06:11 2022] GET /identity/v3/groups/65e62498cb20482ebe9c3411ceffa002 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:11.819630 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baec36c-8e4a-41c6-8da6-1d2d08748314 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:11.863272 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ea6f1-48da-45b9-9a26-b0ca89dbf158 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:11.907157 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec1cb9-a112-43ce-9c91-95a7aa7a3a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:11.907840 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec1cb9-a112-43ce-9c91-95a7aa7a3a81 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:11.908126 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec1cb9-a112-43ce-9c91-95a7aa7a3a81 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:11.908406 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec1cb9-a112-43ce-9c91-95a7aa7a3a81 None admin] PATH_INFO: `/v3/projects/8b0f23b110ec4b0cbf3d045893105ca2` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:11.909607 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec1cb9-a112-43ce-9c91-95a7aa7a3a81 None admin] RBAC: Authorizing `identity:get_project(project_id=8b0f23b110ec4b0cbf3d045893105ca2)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:11.911052 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec1cb9-a112-43ce-9c91-95a7aa7a3a81 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:11.917542 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 237/452] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 9 11:06:11 2022] GET /identity/v3/projects/8b0f23b110ec4b0cbf3d045893105ca2 => generated 344 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:06:11.918429 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec1cb9-a112-43ce-9c91-95a7aa7a3a81 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:11.934109 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baec36c-8e4a-41c6-8da6-1d2d08748314 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:11.966621 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:11.978956 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cc873-8d3a-4f86-812f-d77371936dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:11.979598 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cc873-8d3a-4f86-812f-d77371936dbe None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:11.979883 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cc873-8d3a-4f86-812f-d77371936dbe None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:11.980158 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cc873-8d3a-4f86-812f-d77371936dbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:11.981378 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725cc873-8d3a-4f86-812f-d77371936dbe None admin] RBAC: Adding query filter params (group.id=65e62498cb20482ebe9c3411ceffa002, role.id=60e15fc9c58142f9907a923f384849cc, scope.project.id=73f314874b5a4cbcb9f77b3c1c53b198) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:11.981693 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725cc873-8d3a-4f86-812f-d77371936dbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:11.984120 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725cc873-8d3a-4f86-812f-d77371936dbe None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:11.992486 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 216/453] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 9 11:06:11 2022] GET /identity/v3/role_assignments?group.id=65e62498cb20482ebe9c3411ceffa002&scope.project.id=73f314874b5a4cbcb9f77b3c1c53b198&role.id=60e15fc9c58142f9907a923f384849cc => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:06:12.023680 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:12.040433 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec1cb9-a112-43ce-9c91-95a7aa7a3a81 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:12.083210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec354a3a-ed12-485d-a98e-f29fcc1050ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:12.083863 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec354a3a-ed12-485d-a98e-f29fcc1050ce None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:12.084146 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec354a3a-ed12-485d-a98e-f29fcc1050ce None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:12.084419 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec354a3a-ed12-485d-a98e-f29fcc1050ce None admin] PATH_INFO: `/v3/groups/dea38cc8b8d143b5bb3c63867d9b21f4` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:12.085640 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec354a3a-ed12-485d-a98e-f29fcc1050ce None admin] RBAC: Authorizing `identity:get_group(group_id=dea38cc8b8d143b5bb3c63867d9b21f4)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:12.087119 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec354a3a-ed12-485d-a98e-f29fcc1050ce None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:12.089028 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 238/454] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 9 11:06:11 2022] GET /identity/v3/groups/dea38cc8b8d143b5bb3c63867d9b21f4 => generated 229 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:06:12.095666 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cc873-8d3a-4f86-812f-d77371936dbe None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:12.207521 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cc873-8d3a-4f86-812f-d77371936dbe None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:12.244460 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ac8e4-5491-4dd7-85d5-eceaa1e62a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:12.245064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ac8e4-5491-4dd7-85d5-eceaa1e62a87 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:12.245359 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ac8e4-5491-4dd7-85d5-eceaa1e62a87 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:12.245627 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ac8e4-5491-4dd7-85d5-eceaa1e62a87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:12.246544 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ac8e4-5491-4dd7-85d5-eceaa1e62a87 None admin] RBAC: Adding query filter params (group.id=dea38cc8b8d143b5bb3c63867d9b21f4, role.id=b02ba8c157bf46f4a75cdab917db78db, scope.project.id=8b0f23b110ec4b0cbf3d045893105ca2) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:12.246849 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ac8e4-5491-4dd7-85d5-eceaa1e62a87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:12.249088 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ac8e4-5491-4dd7-85d5-eceaa1e62a87 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:12.256011 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 217/455] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 9 11:06:12 2022] GET /identity/v3/role_assignments?group.id=dea38cc8b8d143b5bb3c63867d9b21f4&scope.project.id=8b0f23b110ec4b0cbf3d045893105ca2&role.id=b02ba8c157bf46f4a75cdab917db78db => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:15.005199 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b11ea-2ed5-4b19-bed6-990cabc8e12c None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:15.005750 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b11ea-2ed5-4b19-bed6-990cabc8e12c None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:15.005750 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b11ea-2ed5-4b19-bed6-990cabc8e12c None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:15.007389 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 239/456] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:15.013040 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25316059-28e4-4c0f-91b8-fabc9039e667 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:15.014069 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25316059-28e4-4c0f-91b8-fabc9039e667 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:15.014283 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25316059-28e4-4c0f-91b8-fabc9039e667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:15.033661 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-25316059-28e4-4c0f-91b8-fabc9039e667 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:15.034875 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-25316059-28e4-4c0f-91b8-fabc9039e667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:15.089861 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:15.109546 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 218/457] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:06:15.177050 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a46b9-e363-460c-864b-b16fd432671d None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:15.177391 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a46b9-e363-460c-864b-b16fd432671d None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:15.177633 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a46b9-e363-460c-864b-b16fd432671d None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:15.179225 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 240/458] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:15.184593 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0fda8-ca80-45ae-ba76-9d16911c336e None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:15.185110 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0fda8-ca80-45ae-ba76-9d16911c336e None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:15.186035 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0fda8-ca80-45ae-ba76-9d16911c336e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:15.205158 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-cca0fda8-ca80-45ae-ba76-9d16911c336e None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:15.206698 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-cca0fda8-ca80-45ae-ba76-9d16911c336e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:15.323473 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 219/459] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:06:15.425673 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6fbee-32ce-4230-b093-d0ce8f06af2e None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:15.426117 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6fbee-32ce-4230-b093-d0ce8f06af2e None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:15.426491 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6fbee-32ce-4230-b093-d0ce8f06af2e None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:15.428173 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 241/460] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:15.433523 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfa384-b572-4408-b48f-146ca0a457af None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:15.433826 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfa384-b572-4408-b48f-146ca0a457af None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:15.434100 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfa384-b572-4408-b48f-146ca0a457af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:15.463692 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-9fcfa384-b572-4408-b48f-146ca0a457af None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:15.464920 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-9fcfa384-b572-4408-b48f-146ca0a457af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:15.490079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6fbee-32ce-4230-b093-d0ce8f06af2e None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:15.590002 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 220/461] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:06:15.635632 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6fbee-32ce-4230-b093-d0ce8f06af2e None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:15.676913 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc94114-77a8-45f0-abb0-7d0c5af349e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:15.677738 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc94114-77a8-45f0-abb0-7d0c5af349e7 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:15.678094 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc94114-77a8-45f0-abb0-7d0c5af349e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:15.678437 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc94114-77a8-45f0-abb0-7d0c5af349e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:15.691414 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc94114-77a8-45f0-abb0-7d0c5af349e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:15.692962 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc94114-77a8-45f0-abb0-7d0c5af349e7 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:15.696257 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45509cb-744a-496b-bee6-421c117896a4 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:15.696543 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45509cb-744a-496b-bee6-421c117896a4 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:15.696817 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45509cb-744a-496b-bee6-421c117896a4 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:15.698490 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 221/462] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:06:15.707021 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdca7b-bd75-4085-93e4-0595b83b09ca None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:15.707280 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdca7b-bd75-4085-93e4-0595b83b09ca None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:15.707512 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdca7b-bd75-4085-93e4-0595b83b09ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:15.715964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-1dc94114-77a8-45f0-abb0-7d0c5af349e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:15.715964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:15.715964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:15.715964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:15.715964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:15.715964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:15.715964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:15.715964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:15.715964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:15.715964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:15.715964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:15.715964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:15.715964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:15.715964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:15.715964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:15.715964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:15.717532 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:15.717532 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:15.717532 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:15.717532 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:15.717532 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:15.717532 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:15.717532 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:15.717532 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:15.717532 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:15.717532 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:15.717532 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:15.717532 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:15.717532 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:15.717532 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:15.717532 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:15.717532 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:15.717532 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:15.718386 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:15.718386 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:15.718386 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:15.725359 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 242/463] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:15.727372 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc94114-77a8-45f0-abb0-7d0c5af349e7 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:15.739359 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:15.744312 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-53bdca7b-bd75-4085-93e4-0595b83b09ca None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:15.745553 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-53bdca7b-bd75-4085-93e4-0595b83b09ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:15.804636 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:15.843744 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 222/464] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:06:15.844501 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bdca7b-bd75-4085-93e4-0595b83b09ca None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:15.861307 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc94114-77a8-45f0-abb0-7d0c5af349e7 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:15.891383 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fc30d-e129-4643-8f17-06460d1c8439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:15.891994 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fc30d-e129-4643-8f17-06460d1c8439 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:15.892274 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fc30d-e129-4643-8f17-06460d1c8439 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:15.892545 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fc30d-e129-4643-8f17-06460d1c8439 None admin] PATH_INFO: `/v3/domains` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:15.893179 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864fc30d-e129-4643-8f17-06460d1c8439 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:15.893524 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864fc30d-e129-4643-8f17-06460d1c8439 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:15.895254 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864fc30d-e129-4643-8f17-06460d1c8439 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:15.908543 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 243/465] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:15.914279 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fc30d-e129-4643-8f17-06460d1c8439 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:15.962678 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bdca7b-bd75-4085-93e4-0595b83b09ca None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:15.993352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:16.002856 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f4cac-fe2f-4c3e-b794-1f383befadf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:16.004065 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f4cac-fe2f-4c3e-b794-1f383befadf4 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:16.004350 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f4cac-fe2f-4c3e-b794-1f383befadf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:16.004612 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f4cac-fe2f-4c3e-b794-1f383befadf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:16.018012 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f4cac-fe2f-4c3e-b794-1f383befadf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:16.019677 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f4cac-fe2f-4c3e-b794-1f383befadf4 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:16.036673 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fc30d-e129-4643-8f17-06460d1c8439 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:16.037168 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-916f4cac-fe2f-4c3e-b794-1f383befadf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:16.037168 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:16.037168 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:16.037168 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:16.037168 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:16.037168 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:16.037168 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:16.037168 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:16.037168 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:16.037168 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:16.037168 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:16.037168 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:16.037168 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:16.037168 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:16.037168 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:16.037168 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:16.038290 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:16.038290 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:16.038290 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:16.038290 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:16.038290 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:16.038290 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:16.038290 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:16.038290 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:16.038290 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:16.038290 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:16.038290 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:16.038290 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:16.038290 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:16.038290 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:16.038290 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:16.038290 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:16.038290 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:16.039153 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:16.039153 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:16.039153 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:16.043271 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 223/466] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:16.044105 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f4cac-fe2f-4c3e-b794-1f383befadf4 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:16.074266 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff446ae-f612-4869-8af1-f61166f9f018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:16.075470 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff446ae-f612-4869-8af1-f61166f9f018 None admin] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:16.075635 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:16.075726 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff446ae-f612-4869-8af1-f61166f9f018 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:16.075726 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff446ae-f612-4869-8af1-f61166f9f018 None admin] PATH_INFO: `/v3/users` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:16.076621 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff446ae-f612-4869-8af1-f61166f9f018 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:16.078423 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff446ae-f612-4869-8af1-f61166f9f018 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:16.105038 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 244/467] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 9 11:06:15 2022] POST /identity/v3/users => generated 246 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:06:16.106299 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff446ae-f612-4869-8af1-f61166f9f018 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:16.183989 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f4cac-fe2f-4c3e-b794-1f383befadf4 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:16.222958 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618b715-7556-4437-b099-959ccecd06db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:16.223601 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618b715-7556-4437-b099-959ccecd06db None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:16.223878 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618b715-7556-4437-b099-959ccecd06db None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:16.224145 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618b715-7556-4437-b099-959ccecd06db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:16.236327 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618b715-7556-4437-b099-959ccecd06db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:16.237841 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618b715-7556-4437-b099-959ccecd06db None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:16.253476 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-2618b715-7556-4437-b099-959ccecd06db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:16.253476 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:16.253476 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:16.253476 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:16.253476 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:16.253476 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:16.253476 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:16.253476 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:16.253476 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:16.253476 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:16.253476 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:16.253476 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:16.253476 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:16.253476 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:16.253476 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:16.253476 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:16.254525 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:16.254525 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:16.254525 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:16.254525 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:16.254525 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:16.254525 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:16.254525 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:16.254525 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:16.254525 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:16.254525 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:16.254525 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:16.254525 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:16.254525 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:16.254525 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:16.254525 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:16.254525 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:16.254525 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:16.255389 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:16.255389 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:16.255389 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:16.255389 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 224/468] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:16.255618 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618b715-7556-4437-b099-959ccecd06db None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:16.268380 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff446ae-f612-4869-8af1-f61166f9f018 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:16.302279 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:16.318093 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcc74a-cdda-4a12-8629-6b43ddb10f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:16.318792 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcc74a-cdda-4a12-8629-6b43ddb10f05 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:16.319151 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcc74a-cdda-4a12-8629-6b43ddb10f05 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:16.319259 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcc74a-cdda-4a12-8629-6b43ddb10f05 None admin] PATH_INFO: `/v3/domains` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:16.320541 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcc74a-cdda-4a12-8629-6b43ddb10f05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:16.320541 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcc74a-cdda-4a12-8629-6b43ddb10f05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:16.321785 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcc74a-cdda-4a12-8629-6b43ddb10f05 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:16.336795 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 245/469] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:16.340566 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcc74a-cdda-4a12-8629-6b43ddb10f05 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:16.355559 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:16.383205 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618b715-7556-4437-b099-959ccecd06db None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:16.419809 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebb598-e92d-4358-88d9-b4d1bd309311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:16.420446 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebb598-e92d-4358-88d9-b4d1bd309311 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:16.420728 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebb598-e92d-4358-88d9-b4d1bd309311 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:16.421000 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebb598-e92d-4358-88d9-b4d1bd309311 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:16.433494 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ebb598-e92d-4358-88d9-b4d1bd309311 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:16.435022 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ebb598-e92d-4358-88d9-b4d1bd309311 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:16.449907 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-a8ebb598-e92d-4358-88d9-b4d1bd309311 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:16.449907 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:16.449907 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:16.449907 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:16.449907 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:16.449907 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:16.449907 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:16.449907 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:16.449907 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:16.449907 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:16.449907 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:16.449907 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:16.449907 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:16.449907 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:16.449907 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:16.449907 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:16.453361 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:16.453361 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:16.453361 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:16.453361 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:16.453361 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:16.453361 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:16.453361 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:16.453361 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:16.453361 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:16.453361 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:16.453361 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:16.453361 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:16.453361 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:16.453361 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:16.453361 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:16.453361 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:16.453361 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:16.454324 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:16.454324 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:16.454324 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:16.454324 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 225/470] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:16.454324 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebb598-e92d-4358-88d9-b4d1bd309311 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:16.462010 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcc74a-cdda-4a12-8629-6b43ddb10f05 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:16.501254 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce968bf-6c36-4fee-95f2-5ce0bc36bc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:16.502031 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce968bf-6c36-4fee-95f2-5ce0bc36bc51 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:16.502382 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce968bf-6c36-4fee-95f2-5ce0bc36bc51 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:16.502720 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce968bf-6c36-4fee-95f2-5ce0bc36bc51 None admin] PATH_INFO: `/v3/domains` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:16.503365 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce968bf-6c36-4fee-95f2-5ce0bc36bc51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:16.503683 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce968bf-6c36-4fee-95f2-5ce0bc36bc51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:16.505045 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce968bf-6c36-4fee-95f2-5ce0bc36bc51 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:16.517783 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 246/471] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:16.519028 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce968bf-6c36-4fee-95f2-5ce0bc36bc51 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:16.567596 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:16.571761 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebb598-e92d-4358-88d9-b4d1bd309311 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:16.602770 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:16.610438 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c1b85-49ed-4aa3-8f2b-91b0292430b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:16.611216 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c1b85-49ed-4aa3-8f2b-91b0292430b0 None admin] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:16.611645 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c1b85-49ed-4aa3-8f2b-91b0292430b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:16.611935 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c1b85-49ed-4aa3-8f2b-91b0292430b0 None admin] PATH_INFO: `/v3/users` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:16.612575 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c1b85-49ed-4aa3-8f2b-91b0292430b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:16.614038 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c1b85-49ed-4aa3-8f2b-91b0292430b0 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:16.629922 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce968bf-6c36-4fee-95f2-5ce0bc36bc51 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:16.636541 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 226/472] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 9 11:06:16 2022] POST /identity/v3/users => generated 248 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:06:16.637373 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c1b85-49ed-4aa3-8f2b-91b0292430b0 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:16.690443 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07afc07a-f950-4072-8b83-2bab1e9b8a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:16.691494 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afc07a-f950-4072-8b83-2bab1e9b8a10 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:16.692592 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afc07a-f950-4072-8b83-2bab1e9b8a10 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:16.693072 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afc07a-f950-4072-8b83-2bab1e9b8a10 None admin] PATH_INFO: `/v3/domains` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:16.694667 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07afc07a-f950-4072-8b83-2bab1e9b8a10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:16.695220 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07afc07a-f950-4072-8b83-2bab1e9b8a10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:16.697697 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07afc07a-f950-4072-8b83-2bab1e9b8a10 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:16.718353 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 247/473] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:16.724769 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07afc07a-f950-4072-8b83-2bab1e9b8a10 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:16.769183 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c1b85-49ed-4aa3-8f2b-91b0292430b0 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:16.810247 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c20be9-f346-459c-9375-299c6861ca11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:16.811131 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c20be9-f346-459c-9375-299c6861ca11 None admin] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:16.811589 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c20be9-f346-459c-9375-299c6861ca11 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:16.812020 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c20be9-f346-459c-9375-299c6861ca11 None admin] PATH_INFO: `/v3/users` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:16.812914 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c20be9-f346-459c-9375-299c6861ca11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:16.814728 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c20be9-f346-459c-9375-299c6861ca11 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:16.843393 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 227/474] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 9 11:06:16 2022] POST /identity/v3/users => generated 248 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:06:16.866962 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07afc07a-f950-4072-8b83-2bab1e9b8a10 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:16.870731 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:16.912726 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30cafb-bd94-47f2-ab45-893e9c089378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:16.914706 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30cafb-bd94-47f2-ab45-893e9c089378 None admin] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:16.914706 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30cafb-bd94-47f2-ab45-893e9c089378 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:16.914706 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30cafb-bd94-47f2-ab45-893e9c089378 None admin] PATH_INFO: `/v3/users` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:16.914706 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30cafb-bd94-47f2-ab45-893e9c089378 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:16.916152 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30cafb-bd94-47f2-ab45-893e9c089378 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:16.944507 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 248/475] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 9 11:06:16 2022] POST /identity/v3/users => generated 249 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:06:18.623030 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce83e61-f85a-4414-9d51-c17a21069162 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:18.623522 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce83e61-f85a-4414-9d51-c17a21069162 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:18.623522 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce83e61-f85a-4414-9d51-c17a21069162 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:18.625062 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 228/476] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:18.630750 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bfbeb-7d08-4194-b63f-a9781703160d None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:18.631230 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bfbeb-7d08-4194-b63f-a9781703160d None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:18.631304 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bfbeb-7d08-4194-b63f-a9781703160d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:18.650384 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-428bfbeb-7d08-4194-b63f-a9781703160d None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:18.651581 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-428bfbeb-7d08-4194-b63f-a9781703160d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:18.725449 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 249/477] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:06:19.058285 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce83e61-f85a-4414-9d51-c17a21069162 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:19.113347 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:19.187611 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce83e61-f85a-4414-9d51-c17a21069162 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:19.227882 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ad29f-8366-42a0-b9d0-2e2276abf759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:19.228913 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ad29f-8366-42a0-b9d0-2e2276abf759 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:19.229442 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ad29f-8366-42a0-b9d0-2e2276abf759 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:19.229927 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ad29f-8366-42a0-b9d0-2e2276abf759 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:19.243767 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ad29f-8366-42a0-b9d0-2e2276abf759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:06:19.249085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-aa9ad29f-8366-42a0-b9d0-2e2276abf759 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:06:19.249085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:19.249085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:19.249085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:19.249085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:19.249085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:19.249085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:19.249085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:19.249085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:19.249085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:19.249085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:19.249085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:19.249085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:06:19.249085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:06:19.249085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:06:19.249085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:06:19.250076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:06:19.250076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:06:19.250076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:06:19.250076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:06:19.250076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:19.250076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:19.250076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:19.250076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:19.250076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:19.250076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:19.250076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:19.250076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:19.250076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:19.250076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:19.250076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:19.250076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:19.250912 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:19.250912 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:19.250912 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:19.250912 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:19.250912 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:06:19.250912 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:06:19.250912 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:06:19.250912 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:06:19.250912 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:06:19.250912 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:06:19.250912 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:06:19.250912 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:19.253688 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 229/478] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 9 11:06:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:19.261448 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428bfbeb-7d08-4194-b63f-a9781703160d None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:19.309493 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37577d-5137-4570-bab8-aa715789b6e2 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:19.310143 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37577d-5137-4570-bab8-aa715789b6e2 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:19.310633 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37577d-5137-4570-bab8-aa715789b6e2 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:19.312537 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 230/479] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:19.318866 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ececcb-c8fc-4d03-84da-50b57ac87136 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:19.318866 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ececcb-c8fc-4d03-84da-50b57ac87136 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:19.319096 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ececcb-c8fc-4d03-84da-50b57ac87136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:19.338851 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-12ececcb-c8fc-4d03-84da-50b57ac87136 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:19.340302 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-12ececcb-c8fc-4d03-84da-50b57ac87136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:19.373740 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:19.389768 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428bfbeb-7d08-4194-b63f-a9781703160d None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:19.428716 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 231/480] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:06:19.429869 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba0e5a-0425-40c7-8dba-56dab5736484 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:19.430150 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba0e5a-0425-40c7-8dba-56dab5736484 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:19.430419 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba0e5a-0425-40c7-8dba-56dab5736484 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:19.431873 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 232/481] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:19.437712 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea37119-14cf-439b-9ccf-6e5e3c97f62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:19.437905 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60d9d0-63a1-45f4-acdc-f6768101445c None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:19.438116 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60d9d0-63a1-45f4-acdc-f6768101445c None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:19.438387 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60d9d0-63a1-45f4-acdc-f6768101445c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:19.439183 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea37119-14cf-439b-9ccf-6e5e3c97f62e None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:19.439693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea37119-14cf-439b-9ccf-6e5e3c97f62e None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:19.440200 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea37119-14cf-439b-9ccf-6e5e3c97f62e None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:19.441210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea37119-14cf-439b-9ccf-6e5e3c97f62e None admin] RBAC: Adding query filter params (name=service) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:19.441817 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea37119-14cf-439b-9ccf-6e5e3c97f62e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:19.443395 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea37119-14cf-439b-9ccf-6e5e3c97f62e None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:19.453107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 250/482] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 9 11:06:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:19.458337 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea37119-14cf-439b-9ccf-6e5e3c97f62e None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:19.461773 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-0d60d9d0-63a1-45f4-acdc-f6768101445c None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:19.463917 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-0d60d9d0-63a1-45f4-acdc-f6768101445c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:19.493235 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:19.537189 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 233/483] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:06:19.538131 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f831d-500b-4a9e-adf5-365faadad782 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:19.538411 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f831d-500b-4a9e-adf5-365faadad782 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:19.538678 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f831d-500b-4a9e-adf5-365faadad782 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:19.544084 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 234/484] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:19.545769 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702184e-e988-4d92-a77b-3203518277f8 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:19.546045 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702184e-e988-4d92-a77b-3203518277f8 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:19.546310 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702184e-e988-4d92-a77b-3203518277f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:19.565494 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-6702184e-e988-4d92-a77b-3203518277f8 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:19.566756 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-6702184e-e988-4d92-a77b-3203518277f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:19.584013 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea37119-14cf-439b-9ccf-6e5e3c97f62e None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:19.629656 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e9eb6-9308-46e5-a126-dc9f9f037876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:19.630863 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e9eb6-9308-46e5-a126-dc9f9f037876 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:19.631983 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e9eb6-9308-46e5-a126-dc9f9f037876 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:19.632405 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e9eb6-9308-46e5-a126-dc9f9f037876 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:19.640269 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 235/485] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:06:19.649766 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e9eb6-9308-46e5-a126-dc9f9f037876 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:19.651457 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e9eb6-9308-46e5-a126-dc9f9f037876 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:19.666941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-8d6e9eb6-9308-46e5-a126-dc9f9f037876 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:19.666941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:19.666941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:19.666941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:19.666941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:19.666941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:19.666941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:19.666941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:19.666941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:19.666941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:19.666941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:19.666941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:19.666941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:19.666941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:19.666941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:19.666941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:19.667871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:19.667871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:19.667871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:19.667871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:19.667871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:19.667871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:19.667871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:19.667871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:19.667871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:19.667871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:19.667871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:19.667871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:19.667871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:19.667871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:19.667871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:19.667871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:19.667871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:19.668951 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:19.668951 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:19.668951 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:19.671411 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 251/486] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:19.677640 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702184e-e988-4d92-a77b-3203518277f8 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:19.756827 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e9eb6-9308-46e5-a126-dc9f9f037876 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:19.761360 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:19.776518 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:19.788210 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702184e-e988-4d92-a77b-3203518277f8 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:19.831262 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bcbad-e75e-4ed8-97c6-b22f05e43a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:19.831936 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bcbad-e75e-4ed8-97c6-b22f05e43a96 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:19.832213 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bcbad-e75e-4ed8-97c6-b22f05e43a96 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:19.832800 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bcbad-e75e-4ed8-97c6-b22f05e43a96 None admin] PATH_INFO: `/v3/domains` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:19.833737 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bcbad-e75e-4ed8-97c6-b22f05e43a96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:19.834035 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bcbad-e75e-4ed8-97c6-b22f05e43a96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:19.835852 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bcbad-e75e-4ed8-97c6-b22f05e43a96 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:19.860884 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 236/487] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:19.866759 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bcbad-e75e-4ed8-97c6-b22f05e43a96 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:19.889820 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e9eb6-9308-46e5-a126-dc9f9f037876 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:19.927086 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e96872-46cc-443b-9e22-0923ce995faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:19.928207 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e96872-46cc-443b-9e22-0923ce995faf None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:19.928679 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e96872-46cc-443b-9e22-0923ce995faf None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:19.929023 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e96872-46cc-443b-9e22-0923ce995faf None admin] PATH_INFO: `/v3/roles/service` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:19.941910 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e96872-46cc-443b-9e22-0923ce995faf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:06:19.947466 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-28e96872-46cc-443b-9e22-0923ce995faf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:06:19.947466 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:19.947466 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:19.947466 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:19.947466 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:19.947466 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:19.947466 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:19.947466 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:19.947466 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:19.947466 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:19.947466 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:19.947466 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:19.947466 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:06:19.947466 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:06:19.947466 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:06:19.947466 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:06:19.948431 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:06:19.948431 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:06:19.948431 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:06:19.948431 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:06:19.948431 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:19.948431 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:19.948431 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:19.948431 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:19.948431 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:19.948431 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:19.948431 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:19.948431 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:19.948431 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:19.948431 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:19.948431 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:19.948431 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:19.949894 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:19.949894 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:19.949894 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:19.949894 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:19.949894 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:06:19.949894 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:06:19.949894 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:06:19.949894 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:06:19.949894 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:06:19.949894 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:06:19.949894 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:06:19.949894 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:19.949894 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 252/488] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 9 11:06:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:19.949894 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e96872-46cc-443b-9e22-0923ce995faf None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:19.979992 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bcbad-e75e-4ed8-97c6-b22f05e43a96 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:20.030202 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:20.031699 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68c5e2-d83a-4bf6-85c5-49e423c2fc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:20.032416 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68c5e2-d83a-4bf6-85c5-49e423c2fc1e None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:20.032699 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68c5e2-d83a-4bf6-85c5-49e423c2fc1e None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:20.033027 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68c5e2-d83a-4bf6-85c5-49e423c2fc1e None admin] PATH_INFO: `/v3/users/nova` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:20.041126 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68c5e2-d83a-4bf6-85c5-49e423c2fc1e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:20.042641 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68c5e2-d83a-4bf6-85c5-49e423c2fc1e None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:20.057179 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-0d68c5e2-d83a-4bf6-85c5-49e423c2fc1e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:06:20.057179 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:20.057179 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:20.057179 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:20.057179 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:20.057179 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:20.057179 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:20.057179 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:20.057179 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:20.057179 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:20.057179 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:20.057179 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:20.057179 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:06:20.057179 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:06:20.057179 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:06:20.057179 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:06:20.058172 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:20.058172 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:20.058172 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:06:20.058172 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:06:20.058172 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:06:20.058172 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:06:20.058172 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:20.058172 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:20.058172 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:20.058172 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:20.058172 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:20.058172 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:20.058172 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:20.058172 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:20.058172 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:20.058172 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:20.058172 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:20.058172 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:20.059064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:20.059064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:20.059064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:06:20.059064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:06:20.059064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:06:20.059064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:06:20.059064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:06:20.059064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:06:20.059064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:06:20.059064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:20.059064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 237/489] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 9 11:06:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:06:20.059642 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68c5e2-d83a-4bf6-85c5-49e423c2fc1e None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:20.080582 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:20.084995 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e96872-46cc-443b-9e22-0923ce995faf None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:20.124312 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1c3e3-a0db-4658-8136-53a855a0fe4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:20.125040 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1c3e3-a0db-4658-8136-53a855a0fe4f None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:20.125416 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1c3e3-a0db-4658-8136-53a855a0fe4f None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:20.125754 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1c3e3-a0db-4658-8136-53a855a0fe4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:20.137197 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b1c3e3-a0db-4658-8136-53a855a0fe4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:06:20.143200 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-d8b1c3e3-a0db-4658-8136-53a855a0fe4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:06:20.143200 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:20.143200 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:20.143200 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:20.143200 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:20.143200 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:20.143200 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:20.143200 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:20.143200 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:20.143200 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:20.143200 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:20.143200 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:20.143200 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:06:20.143200 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:06:20.143200 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:06:20.143200 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:06:20.144352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:06:20.144352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:06:20.144352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:06:20.144352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:06:20.144352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:20.144352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:20.144352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:20.144352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:20.144352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:20.144352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:20.144352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:20.144352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:20.144352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:20.144352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:20.144352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:20.144352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:20.145400 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:20.145400 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:20.145400 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:20.145400 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:20.145400 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:06:20.145400 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:06:20.145400 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:06:20.145400 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:06:20.145400 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:06:20.145400 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:06:20.145400 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:06:20.145400 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:20.145400 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 253/490] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 9 11:06:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:20.145400 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1c3e3-a0db-4658-8136-53a855a0fe4f None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:20.190112 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68c5e2-d83a-4bf6-85c5-49e423c2fc1e None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:20.224992 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102ca9a-3cea-4ce4-b549-434b0963ebf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:20.225626 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102ca9a-3cea-4ce4-b549-434b0963ebf2 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:20.225903 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102ca9a-3cea-4ce4-b549-434b0963ebf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:20.226169 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102ca9a-3cea-4ce4-b549-434b0963ebf2 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:20.226819 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102ca9a-3cea-4ce4-b549-434b0963ebf2 None admin] RBAC: Adding query filter params (name=service) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:20.227110 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102ca9a-3cea-4ce4-b549-434b0963ebf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:20.228475 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102ca9a-3cea-4ce4-b549-434b0963ebf2 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:20.236629 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 238/491] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 9 11:06:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:20.237454 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102ca9a-3cea-4ce4-b549-434b0963ebf2 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:20.262504 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1c3e3-a0db-4658-8136-53a855a0fe4f None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:20.286511 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:20.297671 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadb2a1-8451-477b-922b-e135c0366f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:20.298412 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadb2a1-8451-477b-922b-e135c0366f04 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:20.298691 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadb2a1-8451-477b-922b-e135c0366f04 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:20.298961 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadb2a1-8451-477b-922b-e135c0366f04 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:20.309851 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cadb2a1-8451-477b-922b-e135c0366f04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:06:20.315206 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-8cadb2a1-8451-477b-922b-e135c0366f04 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:06:20.315206 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:20.315206 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:20.315206 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:20.315206 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:20.315206 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:20.315206 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:20.315206 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:20.315206 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:20.315206 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:20.315206 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:20.315206 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:20.315206 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:06:20.315206 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:06:20.315206 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:06:20.315206 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:06:20.316263 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:06:20.316263 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:06:20.316263 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:06:20.316263 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:06:20.316263 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:20.316263 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:20.316263 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:20.316263 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:20.316263 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:20.316263 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:20.316263 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:20.316263 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:20.316263 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:20.316263 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:20.316263 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:20.316263 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:20.317107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:20.317107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:20.317107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:20.317107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:20.317107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:06:20.317107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:06:20.317107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:06:20.317107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:06:20.317107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:06:20.317107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:06:20.317107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:06:20.317107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:20.317107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 254/492] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 9 11:06:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:20.318402 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadb2a1-8451-477b-922b-e135c0366f04 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:20.319027 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:20.351001 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102ca9a-3cea-4ce4-b549-434b0963ebf2 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:20.389180 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec85e6-289c-4711-81bb-5c226f7e3ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:20.389180 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec85e6-289c-4711-81bb-5c226f7e3ff1 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:20.389180 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec85e6-289c-4711-81bb-5c226f7e3ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:20.389180 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec85e6-289c-4711-81bb-5c226f7e3ff1 None admin] PATH_INFO: `/v3/users` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:20.389657 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec85e6-289c-4711-81bb-5c226f7e3ff1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:20.389657 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec85e6-289c-4711-81bb-5c226f7e3ff1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:20.390130 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec85e6-289c-4711-81bb-5c226f7e3ff1 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:20.422784 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadb2a1-8451-477b-922b-e135c0366f04 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:20.430177 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 239/493] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 9 11:06:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:20.430924 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec85e6-289c-4711-81bb-5c226f7e3ff1 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:20.466852 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ac72b-f1e1-4301-a80f-adeea96448e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:20.467464 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ac72b-f1e1-4301-a80f-adeea96448e1 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:20.468035 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ac72b-f1e1-4301-a80f-adeea96448e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:20.468343 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ac72b-f1e1-4301-a80f-adeea96448e1 None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:20.468977 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ac72b-f1e1-4301-a80f-adeea96448e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:20.469274 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ac72b-f1e1-4301-a80f-adeea96448e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:20.470677 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ac72b-f1e1-4301-a80f-adeea96448e1 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:20.479287 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 255/494] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 9 11:06:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:20.480136 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ac72b-f1e1-4301-a80f-adeea96448e1 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:20.532991 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:20.539948 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec85e6-289c-4711-81bb-5c226f7e3ff1 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:20.571153 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:20.576608 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af6a65-5f69-4d15-9696-29732ae0876d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:20.577253 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af6a65-5f69-4d15-9696-29732ae0876d None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:20.577562 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af6a65-5f69-4d15-9696-29732ae0876d None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:20.577833 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af6a65-5f69-4d15-9696-29732ae0876d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:20.588198 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af6a65-5f69-4d15-9696-29732ae0876d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:20.589473 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ac72b-f1e1-4301-a80f-adeea96448e1 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:20.589707 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af6a65-5f69-4d15-9696-29732ae0876d None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:20.606175 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-91af6a65-5f69-4d15-9696-29732ae0876d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:20.606175 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:20.606175 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:20.606175 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:20.606175 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:20.606175 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:20.606175 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:20.606175 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:20.606175 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:20.606175 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:20.606175 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:20.606175 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:20.606175 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:20.606175 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:20.606175 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:20.606175 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:20.607842 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:20.607842 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:20.607842 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:20.607842 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:20.607842 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:20.607842 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:20.607842 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:20.607842 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:20.607842 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:20.607842 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:20.607842 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:20.607842 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:20.607842 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:20.607842 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:20.607842 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:20.607842 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:20.607842 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:20.608884 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:20.608884 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:20.608884 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:20.608884 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 240/495] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:20.608884 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af6a65-5f69-4d15-9696-29732ae0876d None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:20.628156 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76dfc7-3fd2-4793-859a-0c9450173e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:20.628782 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76dfc7-3fd2-4793-859a-0c9450173e39 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:20.629086 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76dfc7-3fd2-4793-859a-0c9450173e39 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:20.629423 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76dfc7-3fd2-4793-859a-0c9450173e39 None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:20.630015 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76dfc7-3fd2-4793-859a-0c9450173e39 None admin] RBAC: Adding query filter params (name=service) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:20.630320 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76dfc7-3fd2-4793-859a-0c9450173e39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:20.631694 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76dfc7-3fd2-4793-859a-0c9450173e39 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:20.640098 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 256/496] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 9 11:06:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:20.640731 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76dfc7-3fd2-4793-859a-0c9450173e39 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:20.741591 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af6a65-5f69-4d15-9696-29732ae0876d None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:20.770387 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76dfc7-3fd2-4793-859a-0c9450173e39 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:20.778263 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7182e91-6262-4da1-8e89-34543a983e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:20.779413 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7182e91-6262-4da1-8e89-34543a983e05 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:20.779696 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7182e91-6262-4da1-8e89-34543a983e05 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:20.779966 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7182e91-6262-4da1-8e89-34543a983e05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:20.781603 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:20.813946 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42c284-6c3a-468a-855c-42519e2251dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:20.814581 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42c284-6c3a-468a-855c-42519e2251dd None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:20.814889 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42c284-6c3a-468a-855c-42519e2251dd None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:20.815168 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42c284-6c3a-468a-855c-42519e2251dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:20.827625 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42c284-6c3a-468a-855c-42519e2251dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:20.829082 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42c284-6c3a-468a-855c-42519e2251dd None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:20.839745 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:20.845735 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-8b42c284-6c3a-468a-855c-42519e2251dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:20.845735 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:20.845735 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:20.845735 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:20.845735 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:20.845735 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:20.845735 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:20.845735 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:20.845735 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:20.845735 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:20.845735 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:20.845735 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:20.845735 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:20.845735 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:20.845735 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:20.845735 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:20.846885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:20.846885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:20.846885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:20.846885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:20.846885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:20.846885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:20.846885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:20.846885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:20.846885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:20.846885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:20.846885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:20.846885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:20.846885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:20.846885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:20.846885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:20.846885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:20.846885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:20.847983 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:20.847983 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:20.847983 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:20.847983 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 257/497] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:20.848204 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42c284-6c3a-468a-855c-42519e2251dd None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:20.864903 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7182e91-6262-4da1-8e89-34543a983e05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:20.866735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7182e91-6262-4da1-8e89-34543a983e05 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:20.959075 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42c284-6c3a-468a-855c-42519e2251dd None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:20.976922 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 241/498] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:06:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:06:20.978277 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7182e91-6262-4da1-8e89-34543a983e05 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:21.001461 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae84ab6-7c1b-4b47-bd10-f31ba5103d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:21.002078 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae84ab6-7c1b-4b47-bd10-f31ba5103d53 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:21.002441 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae84ab6-7c1b-4b47-bd10-f31ba5103d53 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:21.002629 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae84ab6-7c1b-4b47-bd10-f31ba5103d53 None admin] PATH_INFO: `/v3/domains` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:21.003354 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae84ab6-7c1b-4b47-bd10-f31ba5103d53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:21.003650 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae84ab6-7c1b-4b47-bd10-f31ba5103d53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:21.005016 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae84ab6-7c1b-4b47-bd10-f31ba5103d53 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:21.020933 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 258/499] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:21.021803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae84ab6-7c1b-4b47-bd10-f31ba5103d53 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:21.045172 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:21.078977 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:21.098562 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7182e91-6262-4da1-8e89-34543a983e05 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:21.124890 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae84ab6-7c1b-4b47-bd10-f31ba5103d53 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:21.136086 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea11532-aab8-42d1-8fc2-950d10a9081a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:21.136720 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea11532-aab8-42d1-8fc2-950d10a9081a None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:21.137000 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea11532-aab8-42d1-8fc2-950d10a9081a None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:21.137270 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea11532-aab8-42d1-8fc2-950d10a9081a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:21.147368 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea11532-aab8-42d1-8fc2-950d10a9081a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:21.148850 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea11532-aab8-42d1-8fc2-950d10a9081a None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:21.158790 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83620f5-3dcd-4160-8313-04616affd43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:21.159389 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83620f5-3dcd-4160-8313-04616affd43f None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:21.159666 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83620f5-3dcd-4160-8313-04616affd43f None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:21.159929 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83620f5-3dcd-4160-8313-04616affd43f None admin] PATH_INFO: `/v3/domains` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:21.160565 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83620f5-3dcd-4160-8313-04616affd43f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:21.160860 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83620f5-3dcd-4160-8313-04616affd43f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:21.162246 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83620f5-3dcd-4160-8313-04616affd43f None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:21.164715 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-bea11532-aab8-42d1-8fc2-950d10a9081a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:21.164715 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:21.164715 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:21.164715 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:21.164715 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:21.164715 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:21.164715 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:21.164715 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:21.164715 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:21.164715 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:21.164715 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:21.164715 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:21.164715 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:21.164715 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:21.164715 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:21.164715 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:21.165839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:21.165839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:21.165839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:21.165839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:21.165839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:21.165839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:21.165839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:21.165839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:21.165839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:21.165839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:21.165839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:21.165839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:21.165839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:21.165839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:21.165839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:21.165839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:21.165839 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:21.167031 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:21.167031 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:21.167031 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:21.167031 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 242/500] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:21.167031 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea11532-aab8-42d1-8fc2-950d10a9081a None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:21.178314 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 259/501] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:21.179402 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83620f5-3dcd-4160-8313-04616affd43f None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:21.265845 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:21.270362 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea11532-aab8-42d1-8fc2-950d10a9081a None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:21.286698 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83620f5-3dcd-4160-8313-04616affd43f None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:21.305230 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41018e2f-dbd7-497a-834b-4b16bea0d924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:21.305911 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41018e2f-dbd7-497a-834b-4b16bea0d924 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:21.306193 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41018e2f-dbd7-497a-834b-4b16bea0d924 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:21.306468 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41018e2f-dbd7-497a-834b-4b16bea0d924 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:21.309189 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:21.317925 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41018e2f-dbd7-497a-834b-4b16bea0d924 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:21.319485 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41018e2f-dbd7-497a-834b-4b16bea0d924 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:21.324781 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1479108-d78e-4e3f-b4e6-744d1ba571ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:21.325575 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1479108-d78e-4e3f-b4e6-744d1ba571ca None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:21.326054 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1479108-d78e-4e3f-b4e6-744d1ba571ca None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:21.326532 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1479108-d78e-4e3f-b4e6-744d1ba571ca None admin] PATH_INFO: `/v3/users/glance` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:21.337085 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1479108-d78e-4e3f-b4e6-744d1ba571ca None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:21.337263 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-41018e2f-dbd7-497a-834b-4b16bea0d924 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:21.337263 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:21.337263 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:21.337263 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:21.337263 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:21.337263 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:21.337263 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:21.337263 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:21.337263 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:21.337263 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:21.337263 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:21.337263 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:21.337263 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:21.337263 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:21.337263 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:21.337263 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:21.338279 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:21.338279 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:21.338279 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:21.338279 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:21.338279 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:21.338279 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:21.338279 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:21.338279 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:21.338279 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:21.338279 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:21.338279 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:21.338279 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:21.338279 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:21.338279 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:21.338279 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:21.338279 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:21.338279 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:21.339126 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:21.339126 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:21.339126 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:21.339126 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 243/502] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:21.339729 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41018e2f-dbd7-497a-834b-4b16bea0d924 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:21.340045 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1479108-d78e-4e3f-b4e6-744d1ba571ca None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:21.355914 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-d1479108-d78e-4e3f-b4e6-744d1ba571ca None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 11:06:21.355914 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:21.355914 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:21.355914 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:21.355914 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:21.355914 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:21.355914 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:21.355914 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:21.355914 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:21.355914 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:21.355914 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:21.355914 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:21.355914 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:06:21.355914 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:06:21.355914 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:06:21.355914 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:06:21.357030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:21.357030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:21.357030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:06:21.357030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:06:21.357030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:06:21.357030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:06:21.357030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:21.357030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:21.357030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:21.357030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:21.357030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:21.357030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:21.357030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:21.357030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:21.357030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:21.357030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:21.357030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:21.357030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:21.358052 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:21.358052 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:21.358052 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:06:21.358052 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:06:21.358052 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:06:21.358052 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:06:21.358052 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:06:21.358052 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:06:21.358052 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 11:06:21.358052 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:21.358614 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 260/503] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:06:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:21.359054 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1479108-d78e-4e3f-b4e6-744d1ba571ca None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:21.454544 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41018e2f-dbd7-497a-834b-4b16bea0d924 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:21.479535 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1479108-d78e-4e3f-b4e6-744d1ba571ca None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:21.487816 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae9edf-6b9b-4b4d-b4d1-869aefa79d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:21.488420 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae9edf-6b9b-4b4d-b4d1-869aefa79d53 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:21.488697 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae9edf-6b9b-4b4d-b4d1-869aefa79d53 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:21.488966 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae9edf-6b9b-4b4d-b4d1-869aefa79d53 None admin] PATH_INFO: `/v3/domains` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:21.489628 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae9edf-6b9b-4b4d-b4d1-869aefa79d53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:21.489933 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae9edf-6b9b-4b4d-b4d1-869aefa79d53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:21.491291 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae9edf-6b9b-4b4d-b4d1-869aefa79d53 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:21.503761 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 244/504] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:21.504580 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae9edf-6b9b-4b4d-b4d1-869aefa79d53 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:21.519580 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1207add-90c5-430d-895a-6bac3f2e80d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:21.520212 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1207add-90c5-430d-895a-6bac3f2e80d7 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:21.520490 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1207add-90c5-430d-895a-6bac3f2e80d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:21.520764 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1207add-90c5-430d-895a-6bac3f2e80d7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:21.528285 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1207add-90c5-430d-895a-6bac3f2e80d7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:21.529896 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1207add-90c5-430d-895a-6bac3f2e80d7 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:21.532398 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:21.546554 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-b1207add-90c5-430d-895a-6bac3f2e80d7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:06:21.546554 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:21.546554 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:21.546554 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:21.546554 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:21.546554 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:21.546554 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:21.546554 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:21.546554 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:21.546554 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:21.546554 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:21.546554 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:21.546554 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:06:21.546554 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:06:21.546554 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:06:21.546554 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:06:21.547803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:21.547803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:21.547803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:06:21.547803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:06:21.547803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:06:21.547803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:06:21.547803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:21.547803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:21.547803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:21.547803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:21.547803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:21.547803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:21.547803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:21.547803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:21.547803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:21.547803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:21.547803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:21.547803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:21.548955 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:21.548955 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:21.548955 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:06:21.548955 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:06:21.548955 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:06:21.548955 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:06:21.548955 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:06:21.548955 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:06:21.548955 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:06:21.548955 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:21.552439 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 261/505] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:06:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:21.553130 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1207add-90c5-430d-895a-6bac3f2e80d7 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:21.556216 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:21.612284 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae9edf-6b9b-4b4d-b4d1-869aefa79d53 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:21.646747 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b9863-f5f6-4841-a8c8-ea9aeacc423e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:21.647351 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b9863-f5f6-4841-a8c8-ea9aeacc423e None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:21.647635 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b9863-f5f6-4841-a8c8-ea9aeacc423e None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:21.647900 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b9863-f5f6-4841-a8c8-ea9aeacc423e None admin] PATH_INFO: `/v3/domains` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:21.648534 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b9863-f5f6-4841-a8c8-ea9aeacc423e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:21.648831 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b9863-f5f6-4841-a8c8-ea9aeacc423e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:21.650280 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b9863-f5f6-4841-a8c8-ea9aeacc423e None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:21.656296 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1207add-90c5-430d-895a-6bac3f2e80d7 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:21.661912 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 245/506] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:21.662739 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b9863-f5f6-4841-a8c8-ea9aeacc423e None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:21.692802 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa926f-800c-4341-9c1e-8999b91a78a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:21.693451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa926f-800c-4341-9c1e-8999b91a78a5 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:21.693742 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa926f-800c-4341-9c1e-8999b91a78a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:21.694012 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa926f-800c-4341-9c1e-8999b91a78a5 None admin] PATH_INFO: `/v3/users` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:21.694745 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa926f-800c-4341-9c1e-8999b91a78a5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:21.695051 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa926f-800c-4341-9c1e-8999b91a78a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:21.696510 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa926f-800c-4341-9c1e-8999b91a78a5 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:21.735909 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 262/507] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Sep 9 11:06:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:21.736688 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa926f-800c-4341-9c1e-8999b91a78a5 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:21.777027 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b9863-f5f6-4841-a8c8-ea9aeacc423e None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:21.786160 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:21.805081 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:21.813083 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b52046-19a7-4f71-8ab6-cdc00e7a2aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:21.813753 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b52046-19a7-4f71-8ab6-cdc00e7a2aef None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:21.814041 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b52046-19a7-4f71-8ab6-cdc00e7a2aef None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:21.814313 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b52046-19a7-4f71-8ab6-cdc00e7a2aef None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:21.822141 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b52046-19a7-4f71-8ab6-cdc00e7a2aef None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:21.823638 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b52046-19a7-4f71-8ab6-cdc00e7a2aef None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:21.835446 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-54b52046-19a7-4f71-8ab6-cdc00e7a2aef None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 11:06:21.835446 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:21.835446 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:21.835446 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:21.835446 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:21.835446 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:21.835446 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:21.835446 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:21.835446 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:21.835446 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:21.835446 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:21.835446 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:21.835446 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:06:21.835446 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:06:21.835446 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:06:21.835446 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:06:21.836508 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:21.836508 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:21.836508 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:06:21.836508 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:06:21.836508 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:06:21.836508 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:06:21.836508 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:21.836508 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:21.836508 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:21.836508 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:21.836508 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:21.836508 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:21.836508 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:21.836508 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:21.836508 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:21.836508 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:21.836508 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:21.836508 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:21.837437 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:21.837437 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:21.837437 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:06:21.837437 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:06:21.837437 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:06:21.837437 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:06:21.837437 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:06:21.837437 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:06:21.837437 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 11:06:21.837437 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:21.837437 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 246/508] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 9 11:06:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:21.837437 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b52046-19a7-4f71-8ab6-cdc00e7a2aef None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:21.853067 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa926f-800c-4341-9c1e-8999b91a78a5 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:21.890416 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480a701-c5d2-47b6-afba-7c858fbcafd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:21.891027 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480a701-c5d2-47b6-afba-7c858fbcafd4 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:21.891304 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480a701-c5d2-47b6-afba-7c858fbcafd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:21.891576 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480a701-c5d2-47b6-afba-7c858fbcafd4 None admin] PATH_INFO: `/v3/users` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:21.892301 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480a701-c5d2-47b6-afba-7c858fbcafd4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:21.892602 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480a701-c5d2-47b6-afba-7c858fbcafd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:21.894080 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480a701-c5d2-47b6-afba-7c858fbcafd4 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:21.911114 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 263/509] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Sep 9 11:06:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:21.911948 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480a701-c5d2-47b6-afba-7c858fbcafd4 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:21.942641 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b52046-19a7-4f71-8ab6-cdc00e7a2aef None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:21.982244 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31351bab-8aef-44e5-bded-96304ea69f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:21.982992 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31351bab-8aef-44e5-bded-96304ea69f72 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:21.983267 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31351bab-8aef-44e5-bded-96304ea69f72 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:21.983536 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31351bab-8aef-44e5-bded-96304ea69f72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:21.990451 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31351bab-8aef-44e5-bded-96304ea69f72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:21.991840 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31351bab-8aef-44e5-bded-96304ea69f72 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:22.003701 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-31351bab-8aef-44e5-bded-96304ea69f72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:06:22.003701 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:22.003701 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:22.003701 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:22.003701 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:22.003701 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:22.003701 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:22.003701 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:22.003701 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:22.003701 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:22.003701 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:22.003701 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:22.003701 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:06:22.003701 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:06:22.003701 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:06:22.004596 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:06:22.004596 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:22.004596 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:22.004596 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:22.004596 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:22.004596 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:22.004596 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:22.004596 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:22.004596 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:22.004596 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:22.004596 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:22.004596 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:22.004596 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:22.004596 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:22.004596 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:22.004596 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:22.004596 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:22.005527 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:06:22.005527 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:06:22.005527 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:06:22.005527 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:06:22.005527 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:06:22.005527 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:06:22.005527 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:06:22.005527 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:22.005527 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 247/510] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:06:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:22.006000 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31351bab-8aef-44e5-bded-96304ea69f72 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:22.013159 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480a701-c5d2-47b6-afba-7c858fbcafd4 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:22.031934 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:22.036970 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:22.060012 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18448257-a800-4600-8799-87cb4347e19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:22.060622 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18448257-a800-4600-8799-87cb4347e19f None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:22.060907 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18448257-a800-4600-8799-87cb4347e19f None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:22.061226 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18448257-a800-4600-8799-87cb4347e19f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:22.126635 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31351bab-8aef-44e5-bded-96304ea69f72 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:22.137485 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18448257-a800-4600-8799-87cb4347e19f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:22.138998 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18448257-a800-4600-8799-87cb4347e19f None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:22.168784 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c2e54-afdc-4c10-962b-eda7ddcd0e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:22.170371 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c2e54-afdc-4c10-962b-eda7ddcd0e77 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:22.170834 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c2e54-afdc-4c10-962b-eda7ddcd0e77 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:22.171321 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c2e54-afdc-4c10-962b-eda7ddcd0e77 None admin] PATH_INFO: `/v3/users` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:22.172629 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c2e54-afdc-4c10-962b-eda7ddcd0e77 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:22.173156 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c2e54-afdc-4c10-962b-eda7ddcd0e77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:22.175951 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c2e54-afdc-4c10-962b-eda7ddcd0e77 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:22.210822 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 248/511] 10.222.0.20 () {56 vars in 1139 bytes} [Fri Sep 9 11:06:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:22.210822 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c2e54-afdc-4c10-962b-eda7ddcd0e77 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:22.239695 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 264/512] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:06:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:06:22.240622 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18448257-a800-4600-8799-87cb4347e19f None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:22.257810 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:22.306138 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:22.321720 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c2e54-afdc-4c10-962b-eda7ddcd0e77 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:22.344815 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18448257-a800-4600-8799-87cb4347e19f None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:22.357876 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f3759-29ae-499e-a9e3-ffe104abdee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:22.358514 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f3759-29ae-499e-a9e3-ffe104abdee9 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:22.358793 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f3759-29ae-499e-a9e3-ffe104abdee9 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:22.359066 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f3759-29ae-499e-a9e3-ffe104abdee9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:22.379430 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e94c6-f30f-423d-9c0f-298789451595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:22.380028 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e94c6-f30f-423d-9c0f-298789451595 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:22.380304 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e94c6-f30f-423d-9c0f-298789451595 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:22.380572 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e94c6-f30f-423d-9c0f-298789451595 None admin] PATH_INFO: `/v3/projects` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:22.381250 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e94c6-f30f-423d-9c0f-298789451595 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:22.381581 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e94c6-f30f-423d-9c0f-298789451595 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:22.382993 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e94c6-f30f-423d-9c0f-298789451595 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:22.400909 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 265/513] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 9 11:06:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:22.401816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e94c6-f30f-423d-9c0f-298789451595 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:22.431384 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f3759-29ae-499e-a9e3-ffe104abdee9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:22.432927 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f3759-29ae-499e-a9e3-ffe104abdee9 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:22.483561 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:22.507680 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e94c6-f30f-423d-9c0f-298789451595 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:22.525777 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:22.542178 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 249/514] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:06:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:06:22.542811 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f3759-29ae-499e-a9e3-ffe104abdee9 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:22.549822 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2c9ec-d64b-4e55-a1f8-88a35010d21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:22.550437 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2c9ec-d64b-4e55-a1f8-88a35010d21d None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:22.550716 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2c9ec-d64b-4e55-a1f8-88a35010d21d None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:22.551104 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2c9ec-d64b-4e55-a1f8-88a35010d21d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:22.618733 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2c9ec-d64b-4e55-a1f8-88a35010d21d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:22.620199 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2c9ec-d64b-4e55-a1f8-88a35010d21d None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:22.642748 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f3759-29ae-499e-a9e3-ffe104abdee9 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:22.678026 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac70543-91eb-4368-82f2-83f818661161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:22.678647 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac70543-91eb-4368-82f2-83f818661161 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:22.678927 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac70543-91eb-4368-82f2-83f818661161 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:22.679195 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac70543-91eb-4368-82f2-83f818661161 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:22.689928 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac70543-91eb-4368-82f2-83f818661161 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:22.691365 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac70543-91eb-4368-82f2-83f818661161 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:22.697657 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:22.706683 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-0ac70543-91eb-4368-82f2-83f818661161 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:22.706683 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:22.706683 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:22.706683 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:22.706683 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:22.706683 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:22.706683 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:22.706683 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:22.706683 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:22.706683 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:22.706683 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:22.706683 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:22.706683 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:22.706683 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:22.706683 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:22.706683 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:22.707616 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:22.707616 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:22.707616 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:22.707616 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:22.707616 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:22.707616 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:22.707616 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:22.707616 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:22.707616 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:22.707616 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:22.707616 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:22.707616 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:22.707616 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:22.707616 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:22.707616 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:22.707616 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:22.707616 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:22.708557 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:22.708557 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:22.708557 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:22.708557 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 250/515] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:22.708557 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac70543-91eb-4368-82f2-83f818661161 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:22.729948 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 266/516] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:06:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:06:22.730996 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2c9ec-d64b-4e55-a1f8-88a35010d21d None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:22.756071 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:22.822161 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac70543-91eb-4368-82f2-83f818661161 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:22.844088 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2c9ec-d64b-4e55-a1f8-88a35010d21d None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:22.855721 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b3d10-347b-49af-961d-e2c740a306c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:22.856317 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b3d10-347b-49af-961d-e2c740a306c0 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:22.856713 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b3d10-347b-49af-961d-e2c740a306c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:22.856987 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b3d10-347b-49af-961d-e2c740a306c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:22.857747 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b3d10-347b-49af-961d-e2c740a306c0 None admin] RBAC: Adding query filter params (role.id=d2efb827d8084d99971bbe82cfa142e2, scope.project.id=b9cec15abcd74e13ba458c64ad6fdf9b, user.id=417acfbae1244469961371115a42498e) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:22.858052 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b3d10-347b-49af-961d-e2c740a306c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:22.859484 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b3d10-347b-49af-961d-e2c740a306c0 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:22.864929 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 251/517] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:06:22 2022] GET /identity/v3/role_assignments?user.id=417acfbae1244469961371115a42498e&scope.project.id=b9cec15abcd74e13ba458c64ad6fdf9b&role.id=d2efb827d8084d99971bbe82cfa142e2 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:22.865735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b3d10-347b-49af-961d-e2c740a306c0 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:22.882337 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22388ed4-2cab-4d16-9fa6-583322577423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:22.883004 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22388ed4-2cab-4d16-9fa6-583322577423 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:22.883283 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22388ed4-2cab-4d16-9fa6-583322577423 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:22.883559 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22388ed4-2cab-4d16-9fa6-583322577423 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:22.896218 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22388ed4-2cab-4d16-9fa6-583322577423 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:22.897774 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22388ed4-2cab-4d16-9fa6-583322577423 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:22.915430 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-22388ed4-2cab-4d16-9fa6-583322577423 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:22.915430 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:22.915430 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:22.915430 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:22.915430 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:22.915430 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:22.915430 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:22.915430 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:22.915430 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:22.915430 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:22.915430 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:22.915430 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:22.915430 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:22.915430 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:22.915430 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:22.915430 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:22.916410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:22.916410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:22.916410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:22.916410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:22.916410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:22.916410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:22.916410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:22.916410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:22.916410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:22.916410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:22.916410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:22.916410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:22.916410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:22.916410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:22.916410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:22.916410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:22.916410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:22.917275 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:22.917275 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:22.917275 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:22.917275 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 267/518] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:22.917275 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22388ed4-2cab-4d16-9fa6-583322577423 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:22.955487 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:22.981484 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b3d10-347b-49af-961d-e2c740a306c0 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:22.983262 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:23.020344 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b921c-5d30-4c4d-97bb-e8c4b4ea5949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:23.020973 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b921c-5d30-4c4d-97bb-e8c4b4ea5949 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:23.021251 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b921c-5d30-4c4d-97bb-e8c4b4ea5949 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:23.021554 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b921c-5d30-4c4d-97bb-e8c4b4ea5949 None admin] PATH_INFO: `/v3/domains` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:23.022199 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b921c-5d30-4c4d-97bb-e8c4b4ea5949 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:23.022498 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b921c-5d30-4c4d-97bb-e8c4b4ea5949 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:23.023912 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b921c-5d30-4c4d-97bb-e8c4b4ea5949 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:23.041791 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 252/519] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:23.042568 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b921c-5d30-4c4d-97bb-e8c4b4ea5949 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:23.060456 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22388ed4-2cab-4d16-9fa6-583322577423 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:23.098518 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46daa0e3-8288-4427-af38-7ee9a579ea99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:23.099131 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46daa0e3-8288-4427-af38-7ee9a579ea99 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:23.099437 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46daa0e3-8288-4427-af38-7ee9a579ea99 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:23.099706 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46daa0e3-8288-4427-af38-7ee9a579ea99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:23.116323 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46daa0e3-8288-4427-af38-7ee9a579ea99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:23.118525 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46daa0e3-8288-4427-af38-7ee9a579ea99 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:23.135567 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-46daa0e3-8288-4427-af38-7ee9a579ea99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:23.135567 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:23.135567 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:23.135567 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:23.135567 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:23.135567 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:23.135567 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:23.135567 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:23.135567 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:23.135567 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:23.135567 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:23.135567 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:23.135567 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:23.135567 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:23.135567 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:23.135567 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:23.136722 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:23.136722 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:23.136722 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:23.136722 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:23.136722 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:23.136722 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:23.136722 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:23.136722 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:23.136722 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:23.136722 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:23.136722 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:23.136722 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:23.136722 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:23.136722 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:23.136722 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:23.136722 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:23.136722 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:23.138544 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:23.138544 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:23.138544 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:23.141637 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 268/520] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:23.142389 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46daa0e3-8288-4427-af38-7ee9a579ea99 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:23.186801 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b921c-5d30-4c4d-97bb-e8c4b4ea5949 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:23.229606 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b88d0d-e8ae-4742-a2e1-19e73e078d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:23.230340 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b88d0d-e8ae-4742-a2e1-19e73e078d17 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:23.230624 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b88d0d-e8ae-4742-a2e1-19e73e078d17 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:23.230897 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b88d0d-e8ae-4742-a2e1-19e73e078d17 None admin] PATH_INFO: `/v3/domains` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:23.231586 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b88d0d-e8ae-4742-a2e1-19e73e078d17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:23.231894 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b88d0d-e8ae-4742-a2e1-19e73e078d17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:23.233349 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b88d0d-e8ae-4742-a2e1-19e73e078d17 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:23.242386 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:23.246754 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 253/521] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:23.247804 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b88d0d-e8ae-4742-a2e1-19e73e078d17 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:23.270189 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46daa0e3-8288-4427-af38-7ee9a579ea99 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:23.275657 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:23.310058 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f863cc7-9b5d-4d1f-a5c8-467a10905a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:23.310693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f863cc7-9b5d-4d1f-a5c8-467a10905a8e None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:23.310972 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f863cc7-9b5d-4d1f-a5c8-467a10905a8e None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:23.311706 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f863cc7-9b5d-4d1f-a5c8-467a10905a8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:23.321685 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f863cc7-9b5d-4d1f-a5c8-467a10905a8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:23.323181 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f863cc7-9b5d-4d1f-a5c8-467a10905a8e None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:23.336039 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-7f863cc7-9b5d-4d1f-a5c8-467a10905a8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:06:23.336039 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:23.336039 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:23.336039 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:23.336039 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:23.336039 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:23.336039 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:23.336039 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:23.336039 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:23.336039 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:23.336039 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:23.336039 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:23.336039 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:06:23.336039 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:06:23.336039 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:06:23.337091 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:06:23.337091 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:23.337091 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:23.337091 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:23.337091 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:23.337091 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:23.337091 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:23.337091 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:23.337091 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:23.337091 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:23.337091 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:23.337091 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:23.337091 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:23.337091 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:23.337091 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:23.337091 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:23.337091 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:23.338221 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:06:23.338221 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:06:23.338221 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:06:23.338221 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:06:23.338221 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:06:23.338221 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:06:23.338221 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:06:23.338221 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:23.344562 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 269/522] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:06:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:23.344562 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f863cc7-9b5d-4d1f-a5c8-467a10905a8e None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:23.374846 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b88d0d-e8ae-4742-a2e1-19e73e078d17 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:23.414042 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23cd0e-fedc-4d1c-a216-8b4bf11bd922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:23.414652 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23cd0e-fedc-4d1c-a216-8b4bf11bd922 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:23.414937 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23cd0e-fedc-4d1c-a216-8b4bf11bd922 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:23.415203 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23cd0e-fedc-4d1c-a216-8b4bf11bd922 None admin] PATH_INFO: `/v3/domains` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:23.415835 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23cd0e-fedc-4d1c-a216-8b4bf11bd922 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:23.416132 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23cd0e-fedc-4d1c-a216-8b4bf11bd922 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:23.417547 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23cd0e-fedc-4d1c-a216-8b4bf11bd922 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:23.430478 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 254/523] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:23.431312 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23cd0e-fedc-4d1c-a216-8b4bf11bd922 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:23.471769 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f863cc7-9b5d-4d1f-a5c8-467a10905a8e None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:23.522074 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:23.532270 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90369c9-b0a2-469a-9442-7bce3fa753ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:23.533469 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90369c9-b0a2-469a-9442-7bce3fa753ac None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:23.533947 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90369c9-b0a2-469a-9442-7bce3fa753ac None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:23.534400 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90369c9-b0a2-469a-9442-7bce3fa753ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:23.543158 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23cd0e-fedc-4d1c-a216-8b4bf11bd922 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:23.546383 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90369c9-b0a2-469a-9442-7bce3fa753ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:23.549016 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90369c9-b0a2-469a-9442-7bce3fa753ac None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:23.553121 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:23.570314 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-c90369c9-b0a2-469a-9442-7bce3fa753ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:06:23.570314 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:23.570314 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:23.570314 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:23.570314 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:23.570314 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:23.570314 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:23.570314 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:23.570314 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:23.570314 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:23.570314 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:23.570314 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:23.570314 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:06:23.570314 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:06:23.570314 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:06:23.571518 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:06:23.571518 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:23.571518 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:23.571518 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:23.571518 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:23.571518 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:23.571518 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:23.571518 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:23.571518 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:23.571518 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:23.571518 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:23.571518 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:23.571518 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:23.571518 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:23.571518 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:23.571518 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:23.571518 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:23.572551 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:06:23.572551 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:06:23.572551 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:06:23.572551 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:06:23.572551 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:06:23.572551 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:06:23.572551 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:06:23.572551 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:23.574246 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 270/524] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:06:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:23.575027 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90369c9-b0a2-469a-9442-7bce3fa753ac None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:23.592818 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554eb10-93bf-44c9-8253-5a44761cfae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:23.593460 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554eb10-93bf-44c9-8253-5a44761cfae2 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:23.593737 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554eb10-93bf-44c9-8253-5a44761cfae2 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:23.594005 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554eb10-93bf-44c9-8253-5a44761cfae2 None admin] PATH_INFO: `/v3/projects` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:23.594707 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4554eb10-93bf-44c9-8253-5a44761cfae2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:23.595002 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4554eb10-93bf-44c9-8253-5a44761cfae2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:23.596435 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4554eb10-93bf-44c9-8253-5a44761cfae2 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:23.620549 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 255/525] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 9 11:06:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:23.620549 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554eb10-93bf-44c9-8253-5a44761cfae2 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:23.718316 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90369c9-b0a2-469a-9442-7bce3fa753ac None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:23.749639 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554eb10-93bf-44c9-8253-5a44761cfae2 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:23.768183 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a7e6e-a311-4250-81c6-a196fbcafb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:23.769168 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a7e6e-a311-4250-81c6-a196fbcafb82 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:23.769489 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a7e6e-a311-4250-81c6-a196fbcafb82 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:23.769769 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a7e6e-a311-4250-81c6-a196fbcafb82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:23.777422 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a7e6e-a311-4250-81c6-a196fbcafb82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:23.779419 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a7e6e-a311-4250-81c6-a196fbcafb82 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:23.791479 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-814a7e6e-a311-4250-81c6-a196fbcafb82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:06:23.791479 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:23.791479 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:23.791479 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:23.791479 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:23.791479 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:23.791479 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:23.791479 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:23.791479 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:23.791479 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:23.791479 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:23.791479 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:23.791479 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:06:23.791479 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:06:23.791479 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:06:23.792467 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:06:23.792467 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:23.792467 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:23.792467 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:23.792467 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:23.792467 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:23.792467 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:23.792467 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:23.792467 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:23.792467 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:23.792467 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:23.792467 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:23.792467 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:23.792467 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:23.792467 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:23.792467 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:23.792467 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:23.793601 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:06:23.793601 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:06:23.793601 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:06:23.793601 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:06:23.793601 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:06:23.793601 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:06:23.793601 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:06:23.793601 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:23.797794 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 271/526] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:06:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:23.797903 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb219c23-8400-4ce1-8936-e1e73f044a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:23.798584 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb219c23-8400-4ce1-8936-e1e73f044a56 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:23.798697 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a7e6e-a311-4250-81c6-a196fbcafb82 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:23.798934 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb219c23-8400-4ce1-8936-e1e73f044a56 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:23.799388 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb219c23-8400-4ce1-8936-e1e73f044a56 None admin] PATH_INFO: `/v3/projects` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:23.800037 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb219c23-8400-4ce1-8936-e1e73f044a56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:23.800405 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb219c23-8400-4ce1-8936-e1e73f044a56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:23.801942 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb219c23-8400-4ce1-8936-e1e73f044a56 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:23.814543 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 256/527] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 9 11:06:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:23.815215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb219c23-8400-4ce1-8936-e1e73f044a56 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:23.818184 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:23.867294 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:23.929303 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a7e6e-a311-4250-81c6-a196fbcafb82 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:23.936103 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb219c23-8400-4ce1-8936-e1e73f044a56 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:23.965145 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ef985-89ee-4298-80e0-c7820515562e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:23.965839 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ef985-89ee-4298-80e0-c7820515562e None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:23.966723 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ef985-89ee-4298-80e0-c7820515562e None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:23.967004 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ef985-89ee-4298-80e0-c7820515562e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:23.967722 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ef985-89ee-4298-80e0-c7820515562e None admin] RBAC: Adding query filter params (role.id=d2efb827d8084d99971bbe82cfa142e2, scope.project.id=b9cec15abcd74e13ba458c64ad6fdf9b, user.id=9d2e6375358545ac80db469ea4c2deb1) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:23.968097 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ef985-89ee-4298-80e0-c7820515562e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:23.969615 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ef985-89ee-4298-80e0-c7820515562e None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:23.972147 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78de0d0-3249-40db-a2e1-981808264753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:23.972761 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78de0d0-3249-40db-a2e1-981808264753 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:23.973046 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78de0d0-3249-40db-a2e1-981808264753 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:23.973350 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78de0d0-3249-40db-a2e1-981808264753 None admin] PATH_INFO: `/v3/projects` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:23.974038 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78de0d0-3249-40db-a2e1-981808264753 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:23.974345 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78de0d0-3249-40db-a2e1-981808264753 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:23.985700 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 272/528] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:06:23 2022] GET /identity/v3/role_assignments?user.id=9d2e6375358545ac80db469ea4c2deb1&scope.project.id=b9cec15abcd74e13ba458c64ad6fdf9b&role.id=d2efb827d8084d99971bbe82cfa142e2 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:23.985937 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78de0d0-3249-40db-a2e1-981808264753 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:23.986017 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ef985-89ee-4298-80e0-c7820515562e None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:24.004095 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 257/529] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 9 11:06:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:24.005590 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78de0d0-3249-40db-a2e1-981808264753 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:24.105664 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:24.129412 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ef985-89ee-4298-80e0-c7820515562e None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:24.152339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78de0d0-3249-40db-a2e1-981808264753 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:24.160772 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:24.180619 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babaf04-3302-454a-9601-cb93f9508368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:24.181439 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babaf04-3302-454a-9601-cb93f9508368 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:24.181818 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babaf04-3302-454a-9601-cb93f9508368 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:24.182185 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babaf04-3302-454a-9601-cb93f9508368 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:24.183729 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babaf04-3302-454a-9601-cb93f9508368 None admin] RBAC: Adding query filter params (role.id=d2efb827d8084d99971bbe82cfa142e2, scope.project.id=b9cec15abcd74e13ba458c64ad6fdf9b, user.id=c779e851ccf2438594c450eb479c7717) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:24.184183 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babaf04-3302-454a-9601-cb93f9508368 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:24.186741 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babaf04-3302-454a-9601-cb93f9508368 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:24.194296 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 273/530] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:06:23 2022] GET /identity/v3/role_assignments?user.id=c779e851ccf2438594c450eb479c7717&scope.project.id=b9cec15abcd74e13ba458c64ad6fdf9b&role.id=d2efb827d8084d99971bbe82cfa142e2 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:24.204717 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af206e-2a41-47a1-a706-2e497d89e72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:24.205788 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af206e-2a41-47a1-a706-2e497d89e72a None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:24.206230 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af206e-2a41-47a1-a706-2e497d89e72a None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:24.206658 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af206e-2a41-47a1-a706-2e497d89e72a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:24.207614 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af206e-2a41-47a1-a706-2e497d89e72a None admin] RBAC: Adding query filter params (role.id=d2efb827d8084d99971bbe82cfa142e2, scope.project.id=b9cec15abcd74e13ba458c64ad6fdf9b, user.id=1693fd5ca6084609adcb148aa7d7a8d6) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:24.208375 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af206e-2a41-47a1-a706-2e497d89e72a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:24.210340 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af206e-2a41-47a1-a706-2e497d89e72a None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:24.218796 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 258/531] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:06:24 2022] GET /identity/v3/role_assignments?user.id=1693fd5ca6084609adcb148aa7d7a8d6&scope.project.id=b9cec15abcd74e13ba458c64ad6fdf9b&role.id=d2efb827d8084d99971bbe82cfa142e2 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:06:25.364304 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093b59f-2bc3-4fdc-a1e9-0137bbb88676 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:25.364859 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093b59f-2bc3-4fdc-a1e9-0137bbb88676 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:25.364859 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093b59f-2bc3-4fdc-a1e9-0137bbb88676 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:25.366561 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 274/532] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:25.372956 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07b047-6eef-40ea-b3d7-771513c7d93e None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:25.373517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07b047-6eef-40ea-b3d7-771513c7d93e None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:25.373757 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07b047-6eef-40ea-b3d7-771513c7d93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:25.394928 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-dc07b047-6eef-40ea-b3d7-771513c7d93e None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:25.396664 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-dc07b047-6eef-40ea-b3d7-771513c7d93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:25.472763 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 259/533] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:06:25.806963 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093b59f-2bc3-4fdc-a1e9-0137bbb88676 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:25.920147 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093b59f-2bc3-4fdc-a1e9-0137bbb88676 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:25.957013 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b17ab-dbe6-45fd-b397-d4797f48f5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:25.957672 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b17ab-dbe6-45fd-b397-d4797f48f5c3 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:25.958871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b17ab-dbe6-45fd-b397-d4797f48f5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:25.958871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b17ab-dbe6-45fd-b397-d4797f48f5c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:25.971062 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b17ab-dbe6-45fd-b397-d4797f48f5c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:06:25.975900 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-477b17ab-dbe6-45fd-b397-d4797f48f5c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:06:25.975900 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:25.975900 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:25.975900 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:25.975900 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:25.975900 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:25.975900 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:25.975900 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:25.975900 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:25.975900 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:25.975900 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:25.975900 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:25.975900 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:06:25.975900 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:06:25.975900 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:06:25.975900 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:06:25.976938 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:06:25.976938 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:06:25.976938 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:06:25.976938 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:06:25.976938 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:25.976938 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:25.976938 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:25.976938 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:25.976938 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:25.976938 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:25.976938 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:25.976938 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:25.976938 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:25.976938 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:25.976938 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:25.976938 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:25.977881 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:25.977881 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:25.977881 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:25.977881 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:25.977881 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:06:25.977881 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:06:25.977881 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:06:25.977881 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:06:25.977881 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:06:25.977881 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:06:25.977881 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:06:25.977881 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:25.982196 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 275/534] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 9 11:06:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:25.983773 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07b047-6eef-40ea-b3d7-771513c7d93e None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:26.088094 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:26.147663 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07b047-6eef-40ea-b3d7-771513c7d93e None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:26.187834 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2247de-a6f0-47bb-aedf-9edc4a3c7135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:26.189246 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2247de-a6f0-47bb-aedf-9edc4a3c7135 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:26.190095 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2247de-a6f0-47bb-aedf-9edc4a3c7135 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:26.190815 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2247de-a6f0-47bb-aedf-9edc4a3c7135 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:26.192109 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2247de-a6f0-47bb-aedf-9edc4a3c7135 None admin] RBAC: Adding query filter params (name=service) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:26.192776 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2247de-a6f0-47bb-aedf-9edc4a3c7135 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:26.195140 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2247de-a6f0-47bb-aedf-9edc4a3c7135 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:26.205498 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 260/535] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 9 11:06:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:26.214594 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b17ab-dbe6-45fd-b397-d4797f48f5c3 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:26.266240 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:26.323614 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b17ab-dbe6-45fd-b397-d4797f48f5c3 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:26.372942 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a960cf2-50aa-419f-923b-84de4702b972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:26.373629 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a960cf2-50aa-419f-923b-84de4702b972 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:26.374053 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a960cf2-50aa-419f-923b-84de4702b972 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:26.374340 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a960cf2-50aa-419f-923b-84de4702b972 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:26.387361 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a960cf2-50aa-419f-923b-84de4702b972 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:26.389589 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a960cf2-50aa-419f-923b-84de4702b972 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:26.405804 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-4a960cf2-50aa-419f-923b-84de4702b972 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:26.405804 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:26.405804 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:26.405804 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:26.405804 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:26.405804 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:26.405804 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:26.405804 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:26.405804 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:26.405804 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:26.405804 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:26.405804 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:26.405804 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:26.405804 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:26.405804 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:26.405804 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:26.406787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:26.406787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:26.406787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:26.406787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:26.406787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:26.406787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:26.406787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:26.406787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:26.406787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:26.406787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:26.406787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:26.406787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:26.406787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:26.406787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:26.406787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:26.406787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:26.406787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:26.407644 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:26.407644 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:26.407644 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:26.407644 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 276/536] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:26.412777 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2247de-a6f0-47bb-aedf-9edc4a3c7135 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:26.529932 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2247de-a6f0-47bb-aedf-9edc4a3c7135 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:26.532561 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f80ac8-377c-4b67-ab9f-42df48aa089a None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:26.532845 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f80ac8-377c-4b67-ab9f-42df48aa089a None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:26.533116 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f80ac8-377c-4b67-ab9f-42df48aa089a None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:26.534648 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 277/537] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:26.542701 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdc1f6-eadf-4c3f-bf0a-07041bd6f139 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:26.542701 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdc1f6-eadf-4c3f-bf0a-07041bd6f139 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:26.542701 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdc1f6-eadf-4c3f-bf0a-07041bd6f139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:26.561561 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-69bdc1f6-eadf-4c3f-bf0a-07041bd6f139 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:26.562783 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-69bdc1f6-eadf-4c3f-bf0a-07041bd6f139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:26.565679 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:26.585231 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19d1d1-3b08-4e63-91c8-e74cdf1fe489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:26.586123 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19d1d1-3b08-4e63-91c8-e74cdf1fe489 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:26.586554 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19d1d1-3b08-4e63-91c8-e74cdf1fe489 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:26.587127 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19d1d1-3b08-4e63-91c8-e74cdf1fe489 None admin] PATH_INFO: `/v3/domains` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:26.588274 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19d1d1-3b08-4e63-91c8-e74cdf1fe489 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:26.588776 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19d1d1-3b08-4e63-91c8-e74cdf1fe489 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:26.592337 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19d1d1-3b08-4e63-91c8-e74cdf1fe489 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:26.615491 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 261/538] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:26.621090 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19d1d1-3b08-4e63-91c8-e74cdf1fe489 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:26.649591 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 278/539] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:06:26.730109 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19d1d1-3b08-4e63-91c8-e74cdf1fe489 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:26.765437 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16be5d-bc84-49ff-8847-d6c9e2ff1fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:26.766076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16be5d-bc84-49ff-8847-d6c9e2ff1fe5 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:26.766367 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16be5d-bc84-49ff-8847-d6c9e2ff1fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:26.766624 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16be5d-bc84-49ff-8847-d6c9e2ff1fe5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:26.775830 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16be5d-bc84-49ff-8847-d6c9e2ff1fe5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:26.777387 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16be5d-bc84-49ff-8847-d6c9e2ff1fe5 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:26.790351 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-ab16be5d-bc84-49ff-8847-d6c9e2ff1fe5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:06:26.790351 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:26.790351 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:26.790351 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:26.790351 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:26.790351 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:26.790351 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:26.790351 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:26.790351 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:26.790351 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:26.790351 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:26.790351 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:26.790351 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:06:26.790351 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:06:26.790351 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:06:26.790351 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:06:26.792082 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:26.792082 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:26.792082 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:06:26.792082 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:06:26.792082 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:06:26.792082 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:06:26.792082 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:26.792082 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:26.792082 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:26.792082 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:26.792082 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:26.792082 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:26.792082 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:26.792082 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:26.792082 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:26.792082 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:26.792082 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:26.792082 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:26.793523 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:26.793523 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:26.793523 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:06:26.793523 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:06:26.793523 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:06:26.793523 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:06:26.793523 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:06:26.793523 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:06:26.793523 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:06:26.793523 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:26.793523 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 262/540] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 9 11:06:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:06:26.797980 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdc1f6-eadf-4c3f-bf0a-07041bd6f139 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:26.835417 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:26.849355 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2970fd-851c-401c-8b8d-fb0c83d104fb None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:26.849676 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2970fd-851c-401c-8b8d-fb0c83d104fb None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:26.849997 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2970fd-851c-401c-8b8d-fb0c83d104fb None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:26.851589 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 263/541] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:06:26.856627 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672827a-cd65-4b54-8d32-21d01b3af377 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:26.856908 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672827a-cd65-4b54-8d32-21d01b3af377 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:26.857184 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672827a-cd65-4b54-8d32-21d01b3af377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:26.876758 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-5672827a-cd65-4b54-8d32-21d01b3af377 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:26.878000 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-5672827a-cd65-4b54-8d32-21d01b3af377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:26.917927 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:26.918543 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdc1f6-eadf-4c3f-bf0a-07041bd6f139 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:26.965318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 264/542] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:06:26.965546 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e659b-30ac-4d09-8264-d9187d326bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:26.965546 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e659b-30ac-4d09-8264-d9187d326bfa None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:26.965747 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12bf8f-f0c7-41ac-bdfd-dd6063104845 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:26.966422 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e659b-30ac-4d09-8264-d9187d326bfa None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:26.966500 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12bf8f-f0c7-41ac-bdfd-dd6063104845 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:26.966567 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e659b-30ac-4d09-8264-d9187d326bfa None admin] PATH_INFO: `/v3/users` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:26.966632 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12bf8f-f0c7-41ac-bdfd-dd6063104845 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:26.966709 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e659b-30ac-4d09-8264-d9187d326bfa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:26.966709 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e659b-30ac-4d09-8264-d9187d326bfa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:26.966709 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e659b-30ac-4d09-8264-d9187d326bfa None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:26.966903 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 265/543] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:26.969145 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd549b3-7198-4795-8b62-2bc70ac84af5 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:26.969145 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd549b3-7198-4795-8b62-2bc70ac84af5 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:26.969145 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd549b3-7198-4795-8b62-2bc70ac84af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:26.989541 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 279/544] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 9 11:06:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:26.991221 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-1cd549b3-7198-4795-8b62-2bc70ac84af5 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:26.992469 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-1cd549b3-7198-4795-8b62-2bc70ac84af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:26.994370 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e659b-30ac-4d09-8264-d9187d326bfa None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:27.074867 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 266/545] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:06:27.076292 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd549b3-7198-4795-8b62-2bc70ac84af5 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:27.118455 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:27.137022 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e659b-30ac-4d09-8264-d9187d326bfa None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:27.194244 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84f4d7-cd06-49b8-89f3-4fd6c8c1b0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:27.194928 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84f4d7-cd06-49b8-89f3-4fd6c8c1b0c9 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:27.195236 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84f4d7-cd06-49b8-89f3-4fd6c8c1b0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:27.195644 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84f4d7-cd06-49b8-89f3-4fd6c8c1b0c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:27.208206 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84f4d7-cd06-49b8-89f3-4fd6c8c1b0c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:27.209942 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84f4d7-cd06-49b8-89f3-4fd6c8c1b0c9 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:27.226416 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:27.229887 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-cf84f4d7-cd06-49b8-89f3-4fd6c8c1b0c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:27.229887 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:27.229887 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:27.229887 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:27.229887 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:27.229887 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:27.229887 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:27.229887 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:27.229887 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:27.229887 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:27.229887 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:27.229887 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:27.229887 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:27.229887 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:27.229887 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:27.229887 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:27.231116 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:27.231116 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:27.231116 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:27.231116 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:27.231116 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:27.231116 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:27.231116 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:27.231116 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:27.231116 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:27.231116 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:27.231116 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:27.231116 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:27.231116 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:27.231116 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:27.231116 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:27.231116 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:27.231116 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:27.236877 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:27.236877 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:27.236877 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:27.236877 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 280/546] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:27.237109 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd549b3-7198-4795-8b62-2bc70ac84af5 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:27.237184 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84f4d7-cd06-49b8-89f3-4fd6c8c1b0c9 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:27.278512 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c56db-5eb8-47ce-83d1-e6644ac81c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:27.279580 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c56db-5eb8-47ce-83d1-e6644ac81c4e None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:27.280072 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c56db-5eb8-47ce-83d1-e6644ac81c4e None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:27.280558 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c56db-5eb8-47ce-83d1-e6644ac81c4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:27.292200 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c56db-5eb8-47ce-83d1-e6644ac81c4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:06:27.298029 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-d41c56db-5eb8-47ce-83d1-e6644ac81c4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:06:27.298029 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:27.298029 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:27.298029 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:27.298029 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:27.298029 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:27.298029 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:27.298029 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:27.298029 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:27.298029 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:27.298029 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:27.298029 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:27.298029 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:06:27.298029 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:06:27.298029 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:06:27.298029 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:06:27.299005 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:06:27.299005 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:06:27.299005 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:06:27.299005 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:06:27.299005 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:27.299005 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:27.299005 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:27.299005 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:27.299005 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:27.299005 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:27.299005 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:27.299005 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:27.299005 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:27.299005 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:27.299005 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:27.299005 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:27.299832 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:27.299832 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:27.299832 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:27.299832 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:27.299832 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:06:27.299832 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:06:27.299832 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:06:27.299832 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:06:27.299832 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:06:27.299832 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:06:27.299832 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:06:27.299832 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:27.302077 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 267/547] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 9 11:06:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:27.303043 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c56db-5eb8-47ce-83d1-e6644ac81c4e None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:27.366676 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84f4d7-cd06-49b8-89f3-4fd6c8c1b0c9 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:27.401646 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11085b7-74eb-466d-bc05-41f362d7dcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:27.402323 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11085b7-74eb-466d-bc05-41f362d7dcd9 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:27.402518 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11085b7-74eb-466d-bc05-41f362d7dcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:27.402858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11085b7-74eb-466d-bc05-41f362d7dcd9 None admin] PATH_INFO: `/v3/domains` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:27.404080 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11085b7-74eb-466d-bc05-41f362d7dcd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:27.404382 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11085b7-74eb-466d-bc05-41f362d7dcd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:27.405803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11085b7-74eb-466d-bc05-41f362d7dcd9 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:27.412529 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c56db-5eb8-47ce-83d1-e6644ac81c4e None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:27.415174 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:27.423843 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 281/548] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:27.423843 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11085b7-74eb-466d-bc05-41f362d7dcd9 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:27.448231 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd3c0d-8025-4362-a842-b3cdc46b1872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:27.448783 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd3c0d-8025-4362-a842-b3cdc46b1872 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:27.449073 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd3c0d-8025-4362-a842-b3cdc46b1872 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:27.449386 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd3c0d-8025-4362-a842-b3cdc46b1872 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:27.459689 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd3c0d-8025-4362-a842-b3cdc46b1872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:06:27.464482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-c4fd3c0d-8025-4362-a842-b3cdc46b1872 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:06:27.464482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:27.464482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:27.464482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:27.464482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:27.464482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:27.464482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:27.464482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:27.464482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:27.464482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:27.464482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:27.464482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:27.464482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:06:27.464482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:06:27.464482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:06:27.464482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:06:27.465394 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:06:27.465394 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:06:27.465394 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:06:27.465394 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:06:27.465394 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:27.465394 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:27.465394 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:27.465394 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:27.465394 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:27.465394 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:27.465394 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:27.465394 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:27.465394 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:27.465394 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:27.465394 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:27.465394 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:27.466755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:27.466755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:27.466755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:27.466755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:27.466755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:06:27.466755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:06:27.466755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:06:27.466755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:06:27.466755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:06:27.466755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:06:27.466755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:06:27.466755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:27.466755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 268/549] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 9 11:06:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:27.467410 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd3c0d-8025-4362-a842-b3cdc46b1872 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:27.489793 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:27.524719 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11085b7-74eb-466d-bc05-41f362d7dcd9 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:27.561375 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306f68d-3a29-4229-8a54-2a2653ba29bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:27.561982 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306f68d-3a29-4229-8a54-2a2653ba29bf None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:27.562260 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306f68d-3a29-4229-8a54-2a2653ba29bf None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:27.562530 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306f68d-3a29-4229-8a54-2a2653ba29bf None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:27.563191 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306f68d-3a29-4229-8a54-2a2653ba29bf None admin] RBAC: Adding query filter params (name=service) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:27.563492 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306f68d-3a29-4229-8a54-2a2653ba29bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:27.564876 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306f68d-3a29-4229-8a54-2a2653ba29bf None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:27.573566 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 282/550] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 9 11:06:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:27.574085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd3c0d-8025-4362-a842-b3cdc46b1872 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:27.574400 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306f68d-3a29-4229-8a54-2a2653ba29bf None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:27.610557 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9a07f-001f-429e-a8c3-70d23155dcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:27.611187 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9a07f-001f-429e-a8c3-70d23155dcd9 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:27.611461 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9a07f-001f-429e-a8c3-70d23155dcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:27.611736 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9a07f-001f-429e-a8c3-70d23155dcd9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:27.622652 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9a07f-001f-429e-a8c3-70d23155dcd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:06:27.627448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-32b9a07f-001f-429e-a8c3-70d23155dcd9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:06:27.627448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:27.627448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:27.627448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:27.627448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:27.627448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:27.627448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:27.627448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:27.627448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:27.627448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:27.627448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:27.627448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:27.627448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:06:27.627448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:06:27.627448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:06:27.627448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:06:27.628558 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:06:27.628558 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:06:27.628558 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:06:27.628558 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:06:27.628558 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:27.628558 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:27.628558 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:27.628558 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:27.628558 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:27.628558 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:27.628558 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:27.628558 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:27.628558 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:27.628558 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:27.628558 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:27.628558 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:27.630033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:27.630033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:27.630033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:27.630033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:27.630033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:06:27.630033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:06:27.630033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:06:27.630033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:06:27.630033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:06:27.630033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:06:27.630033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:06:27.630033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:27.630033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 269/551] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 9 11:06:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:27.630033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9a07f-001f-429e-a8c3-70d23155dcd9 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:27.640591 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:27.680447 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306f68d-3a29-4229-8a54-2a2653ba29bf None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:27.712589 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:27.714412 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f767137-4ec8-46b0-afcb-0849c2750cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:27.715043 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f767137-4ec8-46b0-afcb-0849c2750cff None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:27.715325 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f767137-4ec8-46b0-afcb-0849c2750cff None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:27.715593 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f767137-4ec8-46b0-afcb-0849c2750cff None admin] PATH_INFO: `/v3/projects/service` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:27.722451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f767137-4ec8-46b0-afcb-0849c2750cff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:27.723903 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f767137-4ec8-46b0-afcb-0849c2750cff None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:27.735139 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9a07f-001f-429e-a8c3-70d23155dcd9 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:27.736539 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-8f767137-4ec8-46b0-afcb-0849c2750cff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:06:27.736539 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:27.736539 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:27.736539 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:27.736539 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:27.736539 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:27.736539 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:27.736539 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:27.736539 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:27.736539 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:27.736539 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:27.736539 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:27.736539 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:06:27.736539 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:06:27.736539 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:06:27.737658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:06:27.737658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:27.737658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:27.737658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:27.737658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:27.737658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:27.737658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:27.737658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:27.737658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:27.737658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:27.737658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:27.737658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:27.737658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:27.737658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:27.737658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:27.737658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:27.737658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:27.739003 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:06:27.739003 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:06:27.739003 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:06:27.739003 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:06:27.739003 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:06:27.739003 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:06:27.739003 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:06:27.739003 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:27.739003 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 283/552] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:06:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:27.739003 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f767137-4ec8-46b0-afcb-0849c2750cff None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:27.774885 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a33d3e-7469-424f-af88-9cf8b2cae0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:27.775491 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a33d3e-7469-424f-af88-9cf8b2cae0c0 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:27.775770 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a33d3e-7469-424f-af88-9cf8b2cae0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:27.776039 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a33d3e-7469-424f-af88-9cf8b2cae0c0 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:27.776707 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a33d3e-7469-424f-af88-9cf8b2cae0c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:27.777008 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a33d3e-7469-424f-af88-9cf8b2cae0c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:27.778548 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a33d3e-7469-424f-af88-9cf8b2cae0c0 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:27.786736 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 270/553] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 9 11:06:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:27.787556 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a33d3e-7469-424f-af88-9cf8b2cae0c0 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:27.845172 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f767137-4ec8-46b0-afcb-0849c2750cff None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:27.868622 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:27.881451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409909d-df92-407f-8ae3-9cbda5e9083c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:27.882080 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409909d-df92-407f-8ae3-9cbda5e9083c None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:27.882364 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409909d-df92-407f-8ae3-9cbda5e9083c None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:27.882622 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409909d-df92-407f-8ae3-9cbda5e9083c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:27.892255 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a33d3e-7469-424f-af88-9cf8b2cae0c0 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:27.893490 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c409909d-df92-407f-8ae3-9cbda5e9083c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:27.894959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c409909d-df92-407f-8ae3-9cbda5e9083c None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:27.909451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-c409909d-df92-407f-8ae3-9cbda5e9083c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:27.909451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:27.909451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:27.909451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:27.909451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:27.909451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:27.909451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:27.909451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:27.909451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:27.909451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:27.909451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:27.909451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:27.909451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:27.909451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:27.909451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:27.909451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:27.910619 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:27.910619 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:27.910619 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:27.910619 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:27.910619 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:27.910619 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:27.910619 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:27.910619 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:27.910619 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:27.910619 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:27.910619 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:27.910619 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:27.910619 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:27.910619 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:27.910619 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:27.910619 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:27.910619 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:27.911677 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:27.911677 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:27.911677 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:27.911677 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 284/554] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:27.911677 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409909d-df92-407f-8ae3-9cbda5e9083c None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:27.933116 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb1726-0dda-426f-aa6d-c590021ce306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:27.933837 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb1726-0dda-426f-aa6d-c590021ce306 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:27.934110 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb1726-0dda-426f-aa6d-c590021ce306 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:27.934381 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb1726-0dda-426f-aa6d-c590021ce306 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:27.935627 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb1726-0dda-426f-aa6d-c590021ce306 None admin] RBAC: Adding query filter params (name=service) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:27.935925 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb1726-0dda-426f-aa6d-c590021ce306 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:27.937321 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb1726-0dda-426f-aa6d-c590021ce306 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:27.946019 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 271/555] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 9 11:06:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:27.946889 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb1726-0dda-426f-aa6d-c590021ce306 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:27.949748 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:28.019225 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409909d-df92-407f-8ae3-9cbda5e9083c None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:28.051892 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb1726-0dda-426f-aa6d-c590021ce306 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:28.054744 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e9b24-dfeb-40ad-8272-7ac3733fa8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:28.055350 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e9b24-dfeb-40ad-8272-7ac3733fa8c7 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:28.055625 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e9b24-dfeb-40ad-8272-7ac3733fa8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:28.055893 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e9b24-dfeb-40ad-8272-7ac3733fa8c7 None admin] PATH_INFO: `/v3/projects` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:28.056576 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e9b24-dfeb-40ad-8272-7ac3733fa8c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:28.056876 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e9b24-dfeb-40ad-8272-7ac3733fa8c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:28.058345 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e9b24-dfeb-40ad-8272-7ac3733fa8c7 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:28.071108 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 285/556] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 9 11:06:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:28.072000 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e9b24-dfeb-40ad-8272-7ac3733fa8c7 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:28.087703 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc31c9-fb06-4906-ba50-e7bf07d3d944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:28.088347 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc31c9-fb06-4906-ba50-e7bf07d3d944 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:28.088628 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc31c9-fb06-4906-ba50-e7bf07d3d944 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:28.088897 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc31c9-fb06-4906-ba50-e7bf07d3d944 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:28.100469 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc31c9-fb06-4906-ba50-e7bf07d3d944 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:28.102065 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc31c9-fb06-4906-ba50-e7bf07d3d944 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:28.111207 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:28.117293 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-e4fc31c9-fb06-4906-ba50-e7bf07d3d944 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:28.117293 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:28.117293 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:28.117293 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:28.117293 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:28.117293 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:28.117293 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:28.117293 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:28.117293 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:28.117293 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:28.117293 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:28.117293 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:28.117293 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:28.117293 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:28.117293 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:28.117293 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:28.118443 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:28.118443 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:28.118443 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:28.118443 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:28.118443 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:28.118443 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:28.118443 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:28.118443 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:28.118443 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:28.118443 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:28.118443 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:28.118443 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:28.118443 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:28.118443 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:28.118443 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:28.118443 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:28.118443 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:28.119488 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:28.119488 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:28.119488 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:28.119488 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 272/557] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:28.119488 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc31c9-fb06-4906-ba50-e7bf07d3d944 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:28.176680 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:28.186820 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e9b24-dfeb-40ad-8272-7ac3733fa8c7 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:28.221176 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4897a-ed70-43bb-a466-de122d721e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:28.221821 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4897a-ed70-43bb-a466-de122d721e70 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:28.222104 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4897a-ed70-43bb-a466-de122d721e70 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:28.222221 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc31c9-fb06-4906-ba50-e7bf07d3d944 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:28.222378 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4897a-ed70-43bb-a466-de122d721e70 None admin] PATH_INFO: `/v3/domains` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:28.223030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4897a-ed70-43bb-a466-de122d721e70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:28.223353 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4897a-ed70-43bb-a466-de122d721e70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:28.224752 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4897a-ed70-43bb-a466-de122d721e70 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:28.237017 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 286/558] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:28.237889 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4897a-ed70-43bb-a466-de122d721e70 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:28.260801 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59c505-4227-4557-b828-307a0f24c8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:28.261486 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59c505-4227-4557-b828-307a0f24c8bd None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:28.261759 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59c505-4227-4557-b828-307a0f24c8bd None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:28.262027 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59c505-4227-4557-b828-307a0f24c8bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:28.274156 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59c505-4227-4557-b828-307a0f24c8bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:28.275534 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59c505-4227-4557-b828-307a0f24c8bd None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:28.290282 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-0a59c505-4227-4557-b828-307a0f24c8bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:28.290282 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:28.290282 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:28.290282 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:28.290282 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:28.290282 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:28.290282 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:28.290282 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:28.290282 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:28.290282 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:28.290282 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:28.290282 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:28.290282 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:28.290282 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:28.290282 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:28.290282 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:28.291458 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:28.291458 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:28.291458 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:28.291458 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:28.291458 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:28.291458 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:28.291458 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:28.291458 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:28.291458 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:28.291458 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:28.291458 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:28.291458 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:28.291458 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:28.291458 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:28.291458 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:28.291458 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:28.291458 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:28.292505 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:28.292505 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:28.292505 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:28.293425 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 273/559] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:28.294864 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59c505-4227-4557-b828-307a0f24c8bd None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:28.335445 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:28.342560 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4897a-ed70-43bb-a466-de122d721e70 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:28.377205 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90877e01-f511-429e-a418-fb578abf6638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:28.377890 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90877e01-f511-429e-a418-fb578abf6638 None admin] REQUEST_METHOD: `PUT` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:28.378169 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90877e01-f511-429e-a418-fb578abf6638 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:28.378454 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90877e01-f511-429e-a418-fb578abf6638 None admin] PATH_INFO: `/v3/projects/b9cec15abcd74e13ba458c64ad6fdf9b/users/417acfbae1244469961371115a42498e/roles/d2efb827d8084d99971bbe82cfa142e2` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:28.393838 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90877e01-f511-429e-a418-fb578abf6638 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9cec15abcd74e13ba458c64ad6fdf9b, user_id=417acfbae1244469961371115a42498e, role_id=d2efb827d8084d99971bbe82cfa142e2)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:28.395278 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90877e01-f511-429e-a418-fb578abf6638 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:28.402429 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59c505-4227-4557-b828-307a0f24c8bd None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:28.409076 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 287/560] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 9 11:06:28 2022] PUT /identity/v3/projects/b9cec15abcd74e13ba458c64ad6fdf9b/users/417acfbae1244469961371115a42498e/roles/d2efb827d8084d99971bbe82cfa142e2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:06:28.409790 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:28.410669 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90877e01-f511-429e-a418-fb578abf6638 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:28.460198 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47674125-bdc4-4cd3-a073-c819cfe3acb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:28.460830 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47674125-bdc4-4cd3-a073-c819cfe3acb8 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:28.461750 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47674125-bdc4-4cd3-a073-c819cfe3acb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:28.462038 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47674125-bdc4-4cd3-a073-c819cfe3acb8 None admin] PATH_INFO: `/v3/domains` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:28.462699 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47674125-bdc4-4cd3-a073-c819cfe3acb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:28.463001 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47674125-bdc4-4cd3-a073-c819cfe3acb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:28.464842 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47674125-bdc4-4cd3-a073-c819cfe3acb8 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:28.478971 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 274/561] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:28.483316 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47674125-bdc4-4cd3-a073-c819cfe3acb8 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:28.536572 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90877e01-f511-429e-a418-fb578abf6638 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:28.578023 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d29f5a-08ef-454d-bdf8-15d819cce52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:28.578682 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d29f5a-08ef-454d-bdf8-15d819cce52c None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:28.579075 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d29f5a-08ef-454d-bdf8-15d819cce52c None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:28.579351 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d29f5a-08ef-454d-bdf8-15d819cce52c None admin] PATH_INFO: `/v3/users/glance` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:28.588084 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d29f5a-08ef-454d-bdf8-15d819cce52c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:28.589804 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d29f5a-08ef-454d-bdf8-15d819cce52c None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:28.604046 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-f0d29f5a-08ef-454d-bdf8-15d819cce52c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 11:06:28.604046 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:28.604046 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:28.604046 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:28.604046 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:28.604046 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:28.604046 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:28.604046 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:28.604046 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:28.604046 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:28.604046 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:28.604046 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:28.604046 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:06:28.604046 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:06:28.604046 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:06:28.604046 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:06:28.605268 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:28.605268 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:28.605268 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:06:28.605268 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:06:28.605268 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:06:28.605268 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:06:28.605268 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:28.605268 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:28.605268 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:28.605268 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:28.605268 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:28.605268 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:28.605268 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:28.605268 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:28.605268 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:28.605268 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:28.605268 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:28.605268 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:28.607124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:28.607124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:28.607124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:06:28.607124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:06:28.607124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:06:28.607124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:06:28.607124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:06:28.607124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:06:28.607124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 11:06:28.607124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:28.607124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 288/562] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:06:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:28.607124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d29f5a-08ef-454d-bdf8-15d819cce52c None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:28.614942 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:28.619938 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47674125-bdc4-4cd3-a073-c819cfe3acb8 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:28.665254 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d189e94-96eb-4e47-a26a-9017caa8d537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:28.666097 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d189e94-96eb-4e47-a26a-9017caa8d537 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:28.666454 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d189e94-96eb-4e47-a26a-9017caa8d537 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:28.666798 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d189e94-96eb-4e47-a26a-9017caa8d537 None admin] PATH_INFO: `/v3/domains` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:28.667578 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d189e94-96eb-4e47-a26a-9017caa8d537 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:28.667984 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d189e94-96eb-4e47-a26a-9017caa8d537 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:28.669800 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d189e94-96eb-4e47-a26a-9017caa8d537 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:28.681710 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 275/563] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:28.682540 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d189e94-96eb-4e47-a26a-9017caa8d537 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:28.712758 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:28.733984 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d29f5a-08ef-454d-bdf8-15d819cce52c None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:28.774534 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22298b3b-3eaa-4978-8eec-9ae08c3f82cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:28.775175 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22298b3b-3eaa-4978-8eec-9ae08c3f82cf None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:28.775458 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22298b3b-3eaa-4978-8eec-9ae08c3f82cf None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:28.775738 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22298b3b-3eaa-4978-8eec-9ae08c3f82cf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:28.784810 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22298b3b-3eaa-4978-8eec-9ae08c3f82cf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:28.786302 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22298b3b-3eaa-4978-8eec-9ae08c3f82cf None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:28.791572 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d189e94-96eb-4e47-a26a-9017caa8d537 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:28.799693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-22298b3b-3eaa-4978-8eec-9ae08c3f82cf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 11:06:28.799693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:28.799693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:28.799693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:28.799693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:28.799693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:28.799693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:28.799693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:28.799693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:28.799693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:28.799693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:28.799693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:28.799693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:06:28.799693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:06:28.799693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:06:28.799693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:06:28.800684 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:28.800684 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:28.800684 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:06:28.800684 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:06:28.800684 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:06:28.800684 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:06:28.800684 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:28.800684 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:28.800684 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:28.800684 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:28.800684 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:28.800684 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:28.800684 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:28.800684 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:28.800684 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:28.800684 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:28.800684 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:28.800684 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:28.801674 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:28.801674 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:28.801674 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:06:28.801674 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:06:28.801674 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:06:28.801674 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:06:28.801674 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:06:28.801674 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:06:28.801674 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 11:06:28.801674 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:28.801674 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 289/564] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 9 11:06:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:28.802306 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22298b3b-3eaa-4978-8eec-9ae08c3f82cf None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:28.832502 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6ef06-93cd-4b67-82f3-aac043990736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:28.833125 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6ef06-93cd-4b67-82f3-aac043990736 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:28.833445 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6ef06-93cd-4b67-82f3-aac043990736 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:28.833728 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6ef06-93cd-4b67-82f3-aac043990736 None admin] PATH_INFO: `/v3/users` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:28.834462 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6ef06-93cd-4b67-82f3-aac043990736 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:28.834771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6ef06-93cd-4b67-82f3-aac043990736 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:28.836258 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6ef06-93cd-4b67-82f3-aac043990736 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:28.856517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 276/565] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Sep 9 11:06:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:28.858029 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6ef06-93cd-4b67-82f3-aac043990736 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:28.875231 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:28.927280 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22298b3b-3eaa-4978-8eec-9ae08c3f82cf None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:28.965969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc979b91-dc3c-4aeb-8882-39be29eb0f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:28.966603 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc979b91-dc3c-4aeb-8882-39be29eb0f7a None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:28.966882 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc979b91-dc3c-4aeb-8882-39be29eb0f7a None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:28.967153 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc979b91-dc3c-4aeb-8882-39be29eb0f7a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:28.968211 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:28.975580 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc979b91-dc3c-4aeb-8882-39be29eb0f7a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:28.977036 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc979b91-dc3c-4aeb-8882-39be29eb0f7a None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:28.985784 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6ef06-93cd-4b67-82f3-aac043990736 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:28.988858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-fc979b91-dc3c-4aeb-8882-39be29eb0f7a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:06:28.988858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:28.988858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:28.988858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:28.988858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:28.988858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:28.988858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:28.988858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:28.988858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:28.988858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:28.988858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:28.988858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:28.988858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:06:28.988858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:06:28.988858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:06:28.988858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:06:28.989998 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:28.989998 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:28.989998 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:06:28.989998 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:06:28.989998 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:06:28.989998 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:06:28.989998 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:28.989998 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:28.989998 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:28.989998 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:28.989998 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:28.989998 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:28.989998 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:28.989998 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:28.989998 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:28.989998 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:28.989998 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:28.989998 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:28.990959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:28.990959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:28.990959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:06:28.990959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:06:28.990959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:06:28.990959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:06:28.990959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:06:28.990959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:06:28.990959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:06:28.990959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:28.990959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 290/566] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:06:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:28.991571 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc979b91-dc3c-4aeb-8882-39be29eb0f7a None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:29.027231 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ca0d7-e407-46e9-8aee-1814e83fb461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:29.027846 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ca0d7-e407-46e9-8aee-1814e83fb461 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:29.028158 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ca0d7-e407-46e9-8aee-1814e83fb461 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:29.028431 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ca0d7-e407-46e9-8aee-1814e83fb461 None admin] PATH_INFO: `/v3/users` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:29.029158 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ca0d7-e407-46e9-8aee-1814e83fb461 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:29.029498 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ca0d7-e407-46e9-8aee-1814e83fb461 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:29.030945 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ca0d7-e407-46e9-8aee-1814e83fb461 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:29.049780 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 277/567] 10.222.0.20 () {56 vars in 1139 bytes} [Fri Sep 9 11:06:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:29.050538 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ca0d7-e407-46e9-8aee-1814e83fb461 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:29.114260 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc979b91-dc3c-4aeb-8882-39be29eb0f7a None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:29.139619 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:29.152895 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c64d1-8560-43e3-b58c-4486e3a6a54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:29.154032 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c64d1-8560-43e3-b58c-4486e3a6a54b None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:29.154512 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c64d1-8560-43e3-b58c-4486e3a6a54b None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:29.154847 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c64d1-8560-43e3-b58c-4486e3a6a54b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:29.156301 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ca0d7-e407-46e9-8aee-1814e83fb461 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:29.166540 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c64d1-8560-43e3-b58c-4486e3a6a54b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:29.168061 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c64d1-8560-43e3-b58c-4486e3a6a54b None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:29.185363 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-9c5c64d1-8560-43e3-b58c-4486e3a6a54b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:29.185363 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:29.185363 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:29.185363 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:29.185363 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:29.185363 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:29.185363 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:29.185363 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:29.185363 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:29.185363 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:29.185363 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:29.185363 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:29.185363 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:29.185363 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:29.185363 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:29.185363 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:29.187352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:29.187352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:29.187352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:29.187352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:29.187352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:29.187352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:29.187352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:29.187352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:29.187352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:29.187352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:29.187352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:29.187352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:29.187352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:29.187352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:29.187352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:29.187352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:29.187352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:29.189132 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:29.189132 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:29.189132 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:29.189132 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 291/568] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:29.189132 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c64d1-8560-43e3-b58c-4486e3a6a54b None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:29.210324 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f92138-9205-4660-a5a5-3acb3b696ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:29.211091 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f92138-9205-4660-a5a5-3acb3b696ada None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:29.211472 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f92138-9205-4660-a5a5-3acb3b696ada None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:29.211844 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f92138-9205-4660-a5a5-3acb3b696ada None admin] PATH_INFO: `/v3/users` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:29.212676 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f92138-9205-4660-a5a5-3acb3b696ada None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:29.213079 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f92138-9205-4660-a5a5-3acb3b696ada None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:29.214679 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f92138-9205-4660-a5a5-3acb3b696ada None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:29.230062 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:29.237435 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 278/569] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Sep 9 11:06:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:29.238940 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f92138-9205-4660-a5a5-3acb3b696ada None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:29.333017 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c64d1-8560-43e3-b58c-4486e3a6a54b None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:29.347505 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f92138-9205-4660-a5a5-3acb3b696ada None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:29.369784 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25da6f-cc00-44ff-8fb0-f045805a2be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:29.370510 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25da6f-cc00-44ff-8fb0-f045805a2be4 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:29.370849 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25da6f-cc00-44ff-8fb0-f045805a2be4 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:29.371124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25da6f-cc00-44ff-8fb0-f045805a2be4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:29.383060 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25da6f-cc00-44ff-8fb0-f045805a2be4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:29.384483 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25da6f-cc00-44ff-8fb0-f045805a2be4 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:29.385966 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebe961-7a90-4038-a078-ab478b6f74cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:29.386681 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebe961-7a90-4038-a078-ab478b6f74cc None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:29.387082 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebe961-7a90-4038-a078-ab478b6f74cc None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:29.387359 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebe961-7a90-4038-a078-ab478b6f74cc None admin] PATH_INFO: `/v3/domains` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:29.388032 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebe961-7a90-4038-a078-ab478b6f74cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:29.388334 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebe961-7a90-4038-a078-ab478b6f74cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:29.389731 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebe961-7a90-4038-a078-ab478b6f74cc None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:29.399210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-9d25da6f-cc00-44ff-8fb0-f045805a2be4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:29.399210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:29.399210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:29.399210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:29.399210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:29.399210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:29.399210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:29.399210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:29.399210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:29.399210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:29.399210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:29.399210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:29.399210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:29.399210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:29.399210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:29.399210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:29.400217 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:29.400217 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:29.400217 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:29.400217 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:29.400217 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:29.400217 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:29.400217 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:29.400217 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:29.400217 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:29.400217 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:29.400217 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:29.400217 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:29.400217 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:29.400217 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:29.400217 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:29.400217 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:29.400217 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:29.401202 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:29.401202 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:29.401202 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:29.401202 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 292/570] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:29.401903 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25da6f-cc00-44ff-8fb0-f045805a2be4 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:29.408616 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 279/571] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:29.408616 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebe961-7a90-4038-a078-ab478b6f74cc None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:29.437371 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:29.483035 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:29.528038 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25da6f-cc00-44ff-8fb0-f045805a2be4 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:29.530232 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebe961-7a90-4038-a078-ab478b6f74cc None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:29.574527 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c5c81-3866-4a83-8011-2d60765a1db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:29.574722 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d93c5c-c297-45e7-ab00-22bbca2c3ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:29.575112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c5c81-3866-4a83-8011-2d60765a1db0 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:29.575234 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d93c5c-c297-45e7-ab00-22bbca2c3ac3 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:29.575398 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c5c81-3866-4a83-8011-2d60765a1db0 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:29.575493 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d93c5c-c297-45e7-ab00-22bbca2c3ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:29.575666 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c5c81-3866-4a83-8011-2d60765a1db0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:29.575762 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d93c5c-c297-45e7-ab00-22bbca2c3ac3 None admin] PATH_INFO: `/v3/domains` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:29.576398 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d93c5c-c297-45e7-ab00-22bbca2c3ac3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:29.576704 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d93c5c-c297-45e7-ab00-22bbca2c3ac3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:29.578331 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d93c5c-c297-45e7-ab00-22bbca2c3ac3 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:29.586767 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c5c81-3866-4a83-8011-2d60765a1db0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:29.588220 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c5c81-3866-4a83-8011-2d60765a1db0 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:29.593427 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 280/572] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:29.594520 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d93c5c-c297-45e7-ab00-22bbca2c3ac3 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:29.607367 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-6f4c5c81-3866-4a83-8011-2d60765a1db0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:29.607367 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:29.607367 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:29.607367 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:29.607367 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:29.607367 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:29.607367 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:29.607367 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:29.607367 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:29.607367 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:29.607367 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:29.607367 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:29.607367 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:29.607367 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:29.607367 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:29.607367 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:29.608605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:29.608605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:29.608605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:29.608605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:29.608605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:29.608605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:29.608605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:29.608605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:29.608605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:29.608605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:29.608605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:29.608605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:29.608605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:29.608605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:29.608605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:29.608605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:29.608605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:29.609768 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:29.609768 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:29.609768 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:29.611229 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 293/573] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:29.612346 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c5c81-3866-4a83-8011-2d60765a1db0 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:29.707870 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:29.708548 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d93c5c-c297-45e7-ab00-22bbca2c3ac3 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:29.729425 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c5c81-3866-4a83-8011-2d60765a1db0 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:29.734190 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:29.754828 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284630bf-3a04-4a5d-884c-39cedafa1b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:29.755563 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284630bf-3a04-4a5d-884c-39cedafa1b2f None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:29.755911 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284630bf-3a04-4a5d-884c-39cedafa1b2f None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:29.756252 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284630bf-3a04-4a5d-884c-39cedafa1b2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:29.764147 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284630bf-3a04-4a5d-884c-39cedafa1b2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:29.765711 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284630bf-3a04-4a5d-884c-39cedafa1b2f None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:29.770344 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a73692-8c40-4eb1-8611-60faef235aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:29.771050 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a73692-8c40-4eb1-8611-60faef235aad None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:29.771410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a73692-8c40-4eb1-8611-60faef235aad None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:29.771753 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a73692-8c40-4eb1-8611-60faef235aad None admin] PATH_INFO: `/v3/projects/service` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:29.777794 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-284630bf-3a04-4a5d-884c-39cedafa1b2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:06:29.777794 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:29.777794 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:29.777794 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:29.777794 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:29.777794 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:29.777794 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:29.777794 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:29.777794 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:29.777794 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:29.777794 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:29.777794 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:29.777794 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:06:29.777794 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:06:29.777794 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:06:29.778928 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:06:29.778928 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:29.778928 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:29.778928 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:29.778928 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:29.778928 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:29.778928 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:29.778928 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:29.778928 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:29.778928 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:29.778928 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:29.778928 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:29.778928 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:29.778928 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:29.778928 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:29.778928 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:29.778928 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:29.779817 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:06:29.779817 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:06:29.779817 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:06:29.779817 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:06:29.779817 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:06:29.779817 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:06:29.779817 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:06:29.779817 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:29.779817 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 281/574] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:06:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:29.779817 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284630bf-3a04-4a5d-884c-39cedafa1b2f None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:29.782701 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a73692-8c40-4eb1-8611-60faef235aad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:29.785449 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a73692-8c40-4eb1-8611-60faef235aad None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:29.799858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-22a73692-8c40-4eb1-8611-60faef235aad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:06:29.799858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:29.799858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:29.799858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:29.799858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:29.799858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:29.799858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:29.799858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:29.799858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:29.799858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:29.799858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:29.799858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:29.799858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:06:29.799858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:06:29.799858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:06:29.800975 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:06:29.800975 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:29.800975 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:29.800975 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:29.800975 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:29.800975 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:29.800975 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:29.800975 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:29.800975 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:29.800975 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:29.800975 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:29.800975 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:29.800975 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:29.800975 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:29.800975 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:29.800975 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:29.800975 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:29.802134 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:06:29.802134 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:06:29.802134 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:06:29.802134 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:06:29.802134 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:06:29.802134 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:06:29.802134 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:06:29.802134 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:29.807900 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 294/575] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:06:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:29.807900 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a73692-8c40-4eb1-8611-60faef235aad None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:29.893224 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284630bf-3a04-4a5d-884c-39cedafa1b2f None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:29.917519 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a73692-8c40-4eb1-8611-60faef235aad None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:29.930346 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22a10f-e4c5-488f-8c82-c93c5819ac88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:29.930959 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22a10f-e4c5-488f-8c82-c93c5819ac88 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:29.931349 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22a10f-e4c5-488f-8c82-c93c5819ac88 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:29.931629 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22a10f-e4c5-488f-8c82-c93c5819ac88 None admin] PATH_INFO: `/v3/domains` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:29.932377 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22a10f-e4c5-488f-8c82-c93c5819ac88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:29.932686 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22a10f-e4c5-488f-8c82-c93c5819ac88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:29.934142 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22a10f-e4c5-488f-8c82-c93c5819ac88 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:29.951745 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 282/576] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:29.951745 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22a10f-e4c5-488f-8c82-c93c5819ac88 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:29.958118 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6d66c-053e-46ed-9315-5120c81874df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:29.958727 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6d66c-053e-46ed-9315-5120c81874df None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:29.959008 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6d66c-053e-46ed-9315-5120c81874df None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:29.959283 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6d66c-053e-46ed-9315-5120c81874df None admin] PATH_INFO: `/v3/projects` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:29.959962 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6d66c-053e-46ed-9315-5120c81874df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:29.960270 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6d66c-053e-46ed-9315-5120c81874df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:29.961746 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6d66c-053e-46ed-9315-5120c81874df None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:29.972299 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:29.980208 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 295/577] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 9 11:06:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:29.980208 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6d66c-053e-46ed-9315-5120c81874df None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:30.002677 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:30.072235 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22a10f-e4c5-488f-8c82-c93c5819ac88 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:30.091569 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6d66c-053e-46ed-9315-5120c81874df None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:30.108534 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f70f01-173a-44c7-9ed4-dc10396d98e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:30.109143 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f70f01-173a-44c7-9ed4-dc10396d98e6 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:30.109450 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f70f01-173a-44c7-9ed4-dc10396d98e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:30.109719 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f70f01-173a-44c7-9ed4-dc10396d98e6 None admin] PATH_INFO: `/v3/projects` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:30.110405 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f70f01-173a-44c7-9ed4-dc10396d98e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:30.110708 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f70f01-173a-44c7-9ed4-dc10396d98e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:30.112133 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f70f01-173a-44c7-9ed4-dc10396d98e6 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:30.129302 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 283/578] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 9 11:06:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:30.129966 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f70f01-173a-44c7-9ed4-dc10396d98e6 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:30.142693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381210c-f4b1-47c0-a43e-a77a17aee843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:30.143724 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381210c-f4b1-47c0-a43e-a77a17aee843 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:30.143955 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381210c-f4b1-47c0-a43e-a77a17aee843 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:30.144386 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381210c-f4b1-47c0-a43e-a77a17aee843 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:30.151539 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381210c-f4b1-47c0-a43e-a77a17aee843 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:30.153081 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381210c-f4b1-47c0-a43e-a77a17aee843 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:30.165228 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-b381210c-f4b1-47c0-a43e-a77a17aee843 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:06:30.165228 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:30.165228 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:30.165228 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:30.165228 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:30.165228 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:30.165228 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:30.165228 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:30.165228 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:30.165228 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:30.165228 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:30.165228 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:30.165228 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:06:30.165228 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:06:30.165228 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:06:30.166176 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:06:30.166176 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:30.166176 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:30.166176 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:30.166176 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:30.166176 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:30.166176 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:30.166176 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:30.166176 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:30.166176 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:30.166176 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:30.166176 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:30.166176 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:30.166176 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:30.166176 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:30.166176 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:30.166176 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:30.167192 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:06:30.167192 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:06:30.167192 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:06:30.167192 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:06:30.167192 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:06:30.167192 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:06:30.167192 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:06:30.167192 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:30.167192 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 296/579] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:06:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:30.167192 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381210c-f4b1-47c0-a43e-a77a17aee843 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:30.237668 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:30.243125 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:30.246239 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f70f01-173a-44c7-9ed4-dc10396d98e6 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:30.282854 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb059b07-b003-4da5-9d49-b207edec07b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:30.283837 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb059b07-b003-4da5-9d49-b207edec07b2 None admin] REQUEST_METHOD: `PUT` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:30.284097 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb059b07-b003-4da5-9d49-b207edec07b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:30.284372 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb059b07-b003-4da5-9d49-b207edec07b2 None admin] PATH_INFO: `/v3/projects/b9cec15abcd74e13ba458c64ad6fdf9b/users/9d2e6375358545ac80db469ea4c2deb1/roles/d2efb827d8084d99971bbe82cfa142e2` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:30.285945 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381210c-f4b1-47c0-a43e-a77a17aee843 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:30.307476 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb059b07-b003-4da5-9d49-b207edec07b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9cec15abcd74e13ba458c64ad6fdf9b, user_id=9d2e6375358545ac80db469ea4c2deb1, role_id=d2efb827d8084d99971bbe82cfa142e2)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:30.308938 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb059b07-b003-4da5-9d49-b207edec07b2 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:30.326030 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 284/580] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 9 11:06:30 2022] PUT /identity/v3/projects/b9cec15abcd74e13ba458c64ad6fdf9b/users/9d2e6375358545ac80db469ea4c2deb1/roles/d2efb827d8084d99971bbe82cfa142e2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:06:30.327188 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb059b07-b003-4da5-9d49-b207edec07b2 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:30.338005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b513029-0259-41f7-8c2b-0a3943df1357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:30.339146 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b513029-0259-41f7-8c2b-0a3943df1357 None admin] REQUEST_METHOD: `PUT` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:30.339717 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b513029-0259-41f7-8c2b-0a3943df1357 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:30.340208 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b513029-0259-41f7-8c2b-0a3943df1357 None admin] PATH_INFO: `/v3/projects/b9cec15abcd74e13ba458c64ad6fdf9b/users/1693fd5ca6084609adcb148aa7d7a8d6/roles/d2efb827d8084d99971bbe82cfa142e2` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:30.360236 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b513029-0259-41f7-8c2b-0a3943df1357 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9cec15abcd74e13ba458c64ad6fdf9b, user_id=1693fd5ca6084609adcb148aa7d7a8d6, role_id=d2efb827d8084d99971bbe82cfa142e2)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:30.362346 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b513029-0259-41f7-8c2b-0a3943df1357 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:30.388261 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 297/581] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 9 11:06:30 2022] PUT /identity/v3/projects/b9cec15abcd74e13ba458c64ad6fdf9b/users/1693fd5ca6084609adcb148aa7d7a8d6/roles/d2efb827d8084d99971bbe82cfa142e2 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:06:30.466815 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb059b07-b003-4da5-9d49-b207edec07b2 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:30.509478 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10738c5-c901-4ef1-b28a-1aac38498a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:30.510156 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10738c5-c901-4ef1-b28a-1aac38498a43 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:30.510444 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10738c5-c901-4ef1-b28a-1aac38498a43 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:30.510616 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10738c5-c901-4ef1-b28a-1aac38498a43 None admin] PATH_INFO: `/v3/projects` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:30.511330 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10738c5-c901-4ef1-b28a-1aac38498a43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:30.511627 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10738c5-c901-4ef1-b28a-1aac38498a43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:30.513255 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10738c5-c901-4ef1-b28a-1aac38498a43 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:30.528871 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 285/582] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 9 11:06:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:30.535011 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b513029-0259-41f7-8c2b-0a3943df1357 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:30.667642 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b513029-0259-41f7-8c2b-0a3943df1357 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:30.680457 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:30.707648 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b6bf5-341c-400c-8371-ec5a2a792a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:30.708705 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b6bf5-341c-400c-8371-ec5a2a792a24 None admin] REQUEST_METHOD: `PUT` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:30.709191 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b6bf5-341c-400c-8371-ec5a2a792a24 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:30.709699 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b6bf5-341c-400c-8371-ec5a2a792a24 None admin] PATH_INFO: `/v3/projects/b9cec15abcd74e13ba458c64ad6fdf9b/users/c779e851ccf2438594c450eb479c7717/roles/d2efb827d8084d99971bbe82cfa142e2` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:30.726091 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b6bf5-341c-400c-8371-ec5a2a792a24 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9cec15abcd74e13ba458c64ad6fdf9b, user_id=c779e851ccf2438594c450eb479c7717, role_id=d2efb827d8084d99971bbe82cfa142e2)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:30.727847 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b6bf5-341c-400c-8371-ec5a2a792a24 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:30.742784 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 298/583] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 9 11:06:30 2022] PUT /identity/v3/projects/b9cec15abcd74e13ba458c64ad6fdf9b/users/c779e851ccf2438594c450eb479c7717/roles/d2efb827d8084d99971bbe82cfa142e2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:06:30.902472 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950f5cb-6eb7-48f3-ae14-57ceb2c49dca None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:30.902810 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950f5cb-6eb7-48f3-ae14-57ceb2c49dca None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:30.903059 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950f5cb-6eb7-48f3-ae14-57ceb2c49dca None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:30.904944 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 286/584] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:30.910977 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df2ff6-7fb3-4073-a8c6-372012a4227f None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:30.911276 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df2ff6-7fb3-4073-a8c6-372012a4227f None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:30.911529 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df2ff6-7fb3-4073-a8c6-372012a4227f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:30.931672 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-29df2ff6-7fb3-4073-a8c6-372012a4227f None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:30.932891 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-29df2ff6-7fb3-4073-a8c6-372012a4227f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:31.017148 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 299/585] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:06:31.341507 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950f5cb-6eb7-48f3-ae14-57ceb2c49dca None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:31.354667 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:31.451495 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950f5cb-6eb7-48f3-ae14-57ceb2c49dca None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:31.491714 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f623be0-7469-4a3e-b013-cd510692a154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:31.492356 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f623be0-7469-4a3e-b013-cd510692a154 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:31.492634 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f623be0-7469-4a3e-b013-cd510692a154 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:31.492902 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f623be0-7469-4a3e-b013-cd510692a154 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:31.504124 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f623be0-7469-4a3e-b013-cd510692a154 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:06:31.509076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-8f623be0-7469-4a3e-b013-cd510692a154 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:06:31.509076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:31.509076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:31.509076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:31.509076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:31.509076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:31.509076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:31.509076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:31.509076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:31.509076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:31.509076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:31.509076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:31.509076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:06:31.509076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:06:31.509076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:06:31.509076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:06:31.510497 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:06:31.510497 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:06:31.510497 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:06:31.510497 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:06:31.510497 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:31.510497 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:31.510497 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:31.510497 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:31.510497 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:31.510497 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:31.510497 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:31.510497 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:31.510497 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:31.510497 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:31.510497 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:31.510497 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:31.511404 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:31.511404 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:31.511404 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:31.511404 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:31.511404 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:06:31.511404 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:06:31.511404 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:06:31.511404 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:06:31.511404 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:06:31.511404 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:06:31.511404 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:06:31.511404 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:31.511404 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 287/586] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 9 11:06:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:31.516920 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df2ff6-7fb3-4073-a8c6-372012a4227f None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:31.618074 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:31.627445 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df2ff6-7fb3-4073-a8c6-372012a4227f None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:31.664540 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe983a-04c3-4f83-9393-5087e9d8248e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:31.665152 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe983a-04c3-4f83-9393-5087e9d8248e None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:31.665462 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe983a-04c3-4f83-9393-5087e9d8248e None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:31.665733 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe983a-04c3-4f83-9393-5087e9d8248e None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:31.666399 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe983a-04c3-4f83-9393-5087e9d8248e None admin] RBAC: Adding query filter params (name=service) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:31.666698 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe983a-04c3-4f83-9393-5087e9d8248e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:31.668064 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe983a-04c3-4f83-9393-5087e9d8248e None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:31.677939 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 300/587] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 9 11:06:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:31.689042 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f623be0-7469-4a3e-b013-cd510692a154 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:31.773752 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:31.807398 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f623be0-7469-4a3e-b013-cd510692a154 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:31.846056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccfa52-e3e9-46f1-840a-776b4103039b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:31.847072 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccfa52-e3e9-46f1-840a-776b4103039b None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:31.847582 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccfa52-e3e9-46f1-840a-776b4103039b None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:31.848070 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccfa52-e3e9-46f1-840a-776b4103039b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:31.860566 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ccfa52-e3e9-46f1-840a-776b4103039b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:31.862574 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ccfa52-e3e9-46f1-840a-776b4103039b None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:31.880383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-25ccfa52-e3e9-46f1-840a-776b4103039b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:31.880383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:31.880383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:31.880383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:31.880383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:31.880383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:31.880383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:31.880383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:31.880383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:31.880383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:31.880383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:31.880383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:31.880383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:31.880383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:31.880383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:31.880383 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:31.881420 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:31.881420 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:31.881420 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:31.881420 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:31.881420 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:31.881420 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:31.881420 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:31.881420 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:31.881420 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:31.881420 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:31.881420 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:31.881420 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:31.881420 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:31.881420 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:31.881420 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:31.881420 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:31.881420 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:31.882336 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:31.882336 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:31.882336 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:31.884501 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 288/588] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:31.890011 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe983a-04c3-4f83-9393-5087e9d8248e None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:31.999481 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe983a-04c3-4f83-9393-5087e9d8248e None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:32.034813 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd38c53-90f7-4913-9373-03c03206f86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:32.035426 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd38c53-90f7-4913-9373-03c03206f86e None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:32.035704 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd38c53-90f7-4913-9373-03c03206f86e None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:32.035973 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd38c53-90f7-4913-9373-03c03206f86e None admin] PATH_INFO: `/v3/domains` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:32.036614 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd38c53-90f7-4913-9373-03c03206f86e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:32.036917 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd38c53-90f7-4913-9373-03c03206f86e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:32.038302 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd38c53-90f7-4913-9373-03c03206f86e None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:32.051651 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 301/589] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:32.057025 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccfa52-e3e9-46f1-840a-776b4103039b None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:32.166603 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccfa52-e3e9-46f1-840a-776b4103039b None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:32.190813 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:32.203307 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c4006-7fd7-4c94-bfeb-d9f353f50a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:32.204367 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c4006-7fd7-4c94-bfeb-d9f353f50a1d None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:32.204834 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c4006-7fd7-4c94-bfeb-d9f353f50a1d None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:32.205140 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c4006-7fd7-4c94-bfeb-d9f353f50a1d None admin] PATH_INFO: `/v3/users/nova` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:32.213535 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c4006-7fd7-4c94-bfeb-d9f353f50a1d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:32.215003 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c4006-7fd7-4c94-bfeb-d9f353f50a1d None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:32.227040 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-a55c4006-7fd7-4c94-bfeb-d9f353f50a1d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:06:32.227040 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:32.227040 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:32.227040 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:32.227040 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:32.227040 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:32.227040 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:32.227040 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:32.227040 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:32.227040 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:32.227040 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:32.227040 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:32.227040 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:06:32.227040 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:06:32.227040 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:06:32.227040 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:06:32.228034 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:32.228034 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:32.228034 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:06:32.228034 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:06:32.228034 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:06:32.228034 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:06:32.228034 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:32.228034 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:32.228034 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:32.228034 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:32.228034 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:32.228034 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:32.228034 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:32.228034 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:32.228034 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:32.228034 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:32.228034 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:32.228034 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:32.229060 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:32.229060 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:32.229060 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:06:32.229060 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:06:32.229060 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:06:32.229060 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:06:32.229060 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:06:32.229060 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:06:32.229060 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:06:32.229060 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:32.229060 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 289/590] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 9 11:06:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:32.234559 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd38c53-90f7-4913-9373-03c03206f86e None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:32.257642 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:32.351264 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd38c53-90f7-4913-9373-03c03206f86e None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:32.388112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6965676-aedc-483f-b3d1-9a7a2c26be96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:32.388723 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6965676-aedc-483f-b3d1-9a7a2c26be96 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:32.389001 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6965676-aedc-483f-b3d1-9a7a2c26be96 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:32.389274 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6965676-aedc-483f-b3d1-9a7a2c26be96 None admin] PATH_INFO: `/v3/users` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:32.390025 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6965676-aedc-483f-b3d1-9a7a2c26be96 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:32.390327 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6965676-aedc-483f-b3d1-9a7a2c26be96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:32.391745 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6965676-aedc-483f-b3d1-9a7a2c26be96 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:32.414636 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 302/591] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 9 11:06:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:32.415996 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c4006-7fd7-4c94-bfeb-d9f353f50a1d None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:32.526455 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c4006-7fd7-4c94-bfeb-d9f353f50a1d None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:32.568362 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6e996-a89b-4684-a948-9e4683a0d66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:32.568979 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6e996-a89b-4684-a948-9e4683a0d66e None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:32.569323 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6e996-a89b-4684-a948-9e4683a0d66e None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:32.569607 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6e996-a89b-4684-a948-9e4683a0d66e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:32.631157 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:32.654345 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6e996-a89b-4684-a948-9e4683a0d66e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:32.656180 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6e996-a89b-4684-a948-9e4683a0d66e None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:32.765568 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 290/592] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:06:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:06:32.770969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6965676-aedc-483f-b3d1-9a7a2c26be96 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:32.853816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:32.888556 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6965676-aedc-483f-b3d1-9a7a2c26be96 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:32.925105 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0af80a-19ad-4142-9ed8-e4cb55204f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:32.925777 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0af80a-19ad-4142-9ed8-e4cb55204f5c None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:32.926061 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0af80a-19ad-4142-9ed8-e4cb55204f5c None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:32.926332 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0af80a-19ad-4142-9ed8-e4cb55204f5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:32.938199 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0af80a-19ad-4142-9ed8-e4cb55204f5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:32.939647 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0af80a-19ad-4142-9ed8-e4cb55204f5c None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:32.955052 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-7e0af80a-19ad-4142-9ed8-e4cb55204f5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:32.955052 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:32.955052 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:32.955052 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:32.955052 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:32.955052 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:32.955052 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:32.955052 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:32.955052 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:32.955052 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:32.955052 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:32.955052 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:32.955052 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:32.955052 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:32.955052 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:32.955052 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:32.956079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:32.956079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:32.956079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:32.956079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:32.956079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:32.956079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:32.956079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:32.956079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:32.956079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:32.956079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:32.956079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:32.956079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:32.956079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:32.956079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:32.956079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:32.956079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:32.956079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:32.956993 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:32.956993 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:32.956993 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:32.960783 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 303/593] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:32.962160 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6e996-a89b-4684-a948-9e4683a0d66e None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:33.029008 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15adf4-cfdf-475d-a3b0-e47eeb93e7d7 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:33.029359 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15adf4-cfdf-475d-a3b0-e47eeb93e7d7 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:33.029589 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15adf4-cfdf-475d-a3b0-e47eeb93e7d7 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:33.031273 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 304/594] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:06:33.036939 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac75f3-4de2-4848-9f5d-df9f42e41adf None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:33.037219 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac75f3-4de2-4848-9f5d-df9f42e41adf None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:33.037529 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac75f3-4de2-4848-9f5d-df9f42e41adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:33.057181 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-a6ac75f3-4de2-4848-9f5d-df9f42e41adf None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:33.058419 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-a6ac75f3-4de2-4848-9f5d-df9f42e41adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:33.067625 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:33.088658 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6e996-a89b-4684-a948-9e4683a0d66e None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:33.128785 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb4089-496b-452f-8674-4c8c4360f2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:33.129328 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb4089-496b-452f-8674-4c8c4360f2bf None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:33.129621 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb4089-496b-452f-8674-4c8c4360f2bf None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:33.129897 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb4089-496b-452f-8674-4c8c4360f2bf None admin] PATH_INFO: `/v3/domains` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:33.130545 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb4089-496b-452f-8674-4c8c4360f2bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:33.130847 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb4089-496b-452f-8674-4c8c4360f2bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:33.132226 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb4089-496b-452f-8674-4c8c4360f2bf None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:33.135167 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 305/595] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:06:33.142895 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68865658-0a02-41b7-8330-e5b6abcfa680 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:33.143224 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68865658-0a02-41b7-8330-e5b6abcfa680 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:33.143459 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68865658-0a02-41b7-8330-e5b6abcfa680 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:33.144966 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 306/596] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:33.150393 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24075c84-114d-4304-8535-6d02307680f5 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:33.150678 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24075c84-114d-4304-8535-6d02307680f5 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:33.150964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24075c84-114d-4304-8535-6d02307680f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:33.153551 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 291/597] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:33.161357 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb4089-496b-452f-8674-4c8c4360f2bf None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:33.174261 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-24075c84-114d-4304-8535-6d02307680f5 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:33.175604 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-24075c84-114d-4304-8535-6d02307680f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:33.249668 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:33.281329 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 307/598] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:06:33.290238 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d761527-a59d-4f5c-8d65-ca0e83abf510 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:33.290522 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d761527-a59d-4f5c-8d65-ca0e83abf510 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:33.290794 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d761527-a59d-4f5c-8d65-ca0e83abf510 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:33.291556 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb4089-496b-452f-8674-4c8c4360f2bf None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:33.297081 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 308/599] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:33.298476 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b6382-c856-4f09-a00c-089f1e8ccb21 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:33.298762 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b6382-c856-4f09-a00c-089f1e8ccb21 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:33.299037 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b6382-c856-4f09-a00c-089f1e8ccb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:33.326347 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-c85b6382-c856-4f09-a00c-089f1e8ccb21 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:33.327555 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-c85b6382-c856-4f09-a00c-089f1e8ccb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:33.332552 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85a83c-1cac-44aa-8d74-8b0fb32f232e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:33.333306 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85a83c-1cac-44aa-8d74-8b0fb32f232e None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:33.333609 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85a83c-1cac-44aa-8d74-8b0fb32f232e None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:33.333881 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85a83c-1cac-44aa-8d74-8b0fb32f232e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:33.342289 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85a83c-1cac-44aa-8d74-8b0fb32f232e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:33.343807 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85a83c-1cac-44aa-8d74-8b0fb32f232e None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:33.355583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-8d85a83c-1cac-44aa-8d74-8b0fb32f232e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:06:33.355583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:33.355583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:33.355583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:33.355583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:33.355583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:33.355583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:33.355583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:33.355583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:33.355583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:33.355583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:33.355583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:33.355583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:06:33.355583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:06:33.355583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:06:33.357188 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:06:33.357188 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:33.357188 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:33.357188 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:33.357188 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:33.357188 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:33.357188 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:33.357188 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:33.357188 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:33.357188 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:33.357188 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:33.357188 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:33.357188 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:33.357188 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:33.357188 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:33.357188 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:33.357188 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:33.358137 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:06:33.358137 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:06:33.358137 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:06:33.358137 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:06:33.358137 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:06:33.358137 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:06:33.358137 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:06:33.358137 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:33.362098 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 292/600] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:06:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:33.363433 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85a83c-1cac-44aa-8d74-8b0fb32f232e None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:33.366295 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:33.409744 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 309/601] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:06:33.472993 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b6382-c856-4f09-a00c-089f1e8ccb21 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:33.474636 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85a83c-1cac-44aa-8d74-8b0fb32f232e None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:33.511867 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43df38d-5086-4cef-bda3-06cff2b3d5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:33.513043 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43df38d-5086-4cef-bda3-06cff2b3d5b0 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:33.513355 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43df38d-5086-4cef-bda3-06cff2b3d5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:33.513634 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43df38d-5086-4cef-bda3-06cff2b3d5b0 None admin] PATH_INFO: `/v3/projects` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:33.514331 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43df38d-5086-4cef-bda3-06cff2b3d5b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:33.514702 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43df38d-5086-4cef-bda3-06cff2b3d5b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:33.516723 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43df38d-5086-4cef-bda3-06cff2b3d5b0 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:33.534155 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 293/602] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 9 11:06:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:06:33.540549 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43df38d-5086-4cef-bda3-06cff2b3d5b0 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:33.590126 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b6382-c856-4f09-a00c-089f1e8ccb21 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:33.618582 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:33.621422 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:33.634306 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c95bf4-7472-4f4f-8291-012b1ce66c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:33.634949 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c95bf4-7472-4f4f-8291-012b1ce66c5d None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:33.635669 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c95bf4-7472-4f4f-8291-012b1ce66c5d None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:33.636030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c95bf4-7472-4f4f-8291-012b1ce66c5d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:33.648458 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c95bf4-7472-4f4f-8291-012b1ce66c5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:06:33.653969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-79c95bf4-7472-4f4f-8291-012b1ce66c5d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:06:33.653969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:33.653969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:33.653969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:33.653969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:33.653969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:33.653969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:33.653969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:33.653969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:33.653969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:33.653969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:33.653969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:33.653969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:06:33.653969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:06:33.653969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:06:33.653969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:06:33.654883 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:06:33.654883 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:06:33.654883 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:06:33.654883 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:06:33.654883 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:33.654883 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:33.654883 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:33.654883 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:33.654883 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:33.654883 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:33.654883 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:33.654883 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:33.654883 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:33.654883 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:33.654883 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:33.654883 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:33.655803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:33.655803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:33.655803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:33.655803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:33.655803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:06:33.655803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:06:33.655803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:06:33.655803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:06:33.655803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:06:33.655803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:06:33.655803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:06:33.655803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:33.659997 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 310/603] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 9 11:06:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:06:33.660800 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c95bf4-7472-4f4f-8291-012b1ce66c5d None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:33.666269 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43df38d-5086-4cef-bda3-06cff2b3d5b0 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:33.702436 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf706c-3032-4846-abdb-5a1ca0ed6cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:33.703039 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf706c-3032-4846-abdb-5a1ca0ed6cd3 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:33.703316 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf706c-3032-4846-abdb-5a1ca0ed6cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:33.703589 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf706c-3032-4846-abdb-5a1ca0ed6cd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:33.704308 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf706c-3032-4846-abdb-5a1ca0ed6cd3 None admin] RBAC: Adding query filter params (role.id=d2efb827d8084d99971bbe82cfa142e2, scope.project.id=b9cec15abcd74e13ba458c64ad6fdf9b, user.id=417acfbae1244469961371115a42498e) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:33.704613 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf706c-3032-4846-abdb-5a1ca0ed6cd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:33.706071 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf706c-3032-4846-abdb-5a1ca0ed6cd3 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:33.712031 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 294/604] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:06:33 2022] GET /identity/v3/role_assignments?user.id=417acfbae1244469961371115a42498e&scope.project.id=b9cec15abcd74e13ba458c64ad6fdf9b&role.id=d2efb827d8084d99971bbe82cfa142e2 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:33.712849 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf706c-3032-4846-abdb-5a1ca0ed6cd3 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:33.782889 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c95bf4-7472-4f4f-8291-012b1ce66c5d None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:33.824324 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104b203-60be-4072-8ff8-7db59b0ed7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:33.825515 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104b203-60be-4072-8ff8-7db59b0ed7e9 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:33.825801 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104b203-60be-4072-8ff8-7db59b0ed7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:33.826073 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104b203-60be-4072-8ff8-7db59b0ed7e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:33.837021 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf706c-3032-4846-abdb-5a1ca0ed6cd3 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:33.838530 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4104b203-60be-4072-8ff8-7db59b0ed7e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:06:33.844546 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-4104b203-60be-4072-8ff8-7db59b0ed7e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:06:33.844546 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:33.844546 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:33.844546 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:33.844546 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:33.844546 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:33.844546 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:33.844546 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:33.844546 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:33.844546 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:33.844546 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:33.844546 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:33.844546 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:06:33.844546 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:06:33.844546 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:06:33.844546 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:06:33.845581 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:06:33.845581 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:06:33.845581 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:06:33.845581 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:06:33.845581 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:33.845581 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:33.845581 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:33.845581 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:33.845581 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:33.845581 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:33.845581 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:33.845581 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:33.845581 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:33.845581 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:33.845581 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:33.845581 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:33.846428 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:33.846428 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:33.846428 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:33.846428 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:33.846428 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:06:33.846428 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:06:33.846428 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:06:33.846428 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:06:33.846428 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:06:33.846428 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:06:33.846428 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:06:33.846428 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:33.846428 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 311/605] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 9 11:06:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:33.847155 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104b203-60be-4072-8ff8-7db59b0ed7e9 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:33.876913 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:33.884577 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:33.890515 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dd7f9-2969-41ce-a5f6-50866befb692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:33.891162 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dd7f9-2969-41ce-a5f6-50866befb692 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:33.891441 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dd7f9-2969-41ce-a5f6-50866befb692 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:33.891712 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dd7f9-2969-41ce-a5f6-50866befb692 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:33.892408 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85dd7f9-2969-41ce-a5f6-50866befb692 None admin] RBAC: Adding query filter params (name=service) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:33.892712 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85dd7f9-2969-41ce-a5f6-50866befb692 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:33.894151 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85dd7f9-2969-41ce-a5f6-50866befb692 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:33.905905 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 295/606] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 9 11:06:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:33.907070 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dd7f9-2969-41ce-a5f6-50866befb692 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:33.970033 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104b203-60be-4072-8ff8-7db59b0ed7e9 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:34.014796 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59ee63-c2ac-4539-ba82-00b4a4043a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:34.015441 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59ee63-c2ac-4539-ba82-00b4a4043a7a None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:34.015721 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59ee63-c2ac-4539-ba82-00b4a4043a7a None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:34.016492 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59ee63-c2ac-4539-ba82-00b4a4043a7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:34.028983 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59ee63-c2ac-4539-ba82-00b4a4043a7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:06:34.031355 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dd7f9-2969-41ce-a5f6-50866befb692 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:34.034112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-5b59ee63-c2ac-4539-ba82-00b4a4043a7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:06:34.034112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:34.034112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:34.034112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:34.034112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:34.034112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:34.034112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:34.034112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:34.034112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:34.034112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:34.034112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:34.034112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:34.034112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:06:34.034112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:06:34.034112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:06:34.034112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:06:34.035077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:06:34.035077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:06:34.035077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:06:34.035077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:06:34.035077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:34.035077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:34.035077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:34.035077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:34.035077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:34.035077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:34.035077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:34.035077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:34.035077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:34.035077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:34.035077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:34.035077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:34.035937 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:34.035937 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:34.035937 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:34.035937 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:34.035937 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:06:34.035937 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:06:34.035937 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:06:34.035937 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:06:34.035937 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:06:34.035937 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:06:34.035937 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:06:34.035937 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:34.035937 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 312/607] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 9 11:06:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:34.036631 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59ee63-c2ac-4539-ba82-00b4a4043a7a None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:34.072918 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3807de2-ed98-4501-88df-697a63e86490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:34.073654 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3807de2-ed98-4501-88df-697a63e86490 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:34.074026 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3807de2-ed98-4501-88df-697a63e86490 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:34.074314 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3807de2-ed98-4501-88df-697a63e86490 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:34.075042 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3807de2-ed98-4501-88df-697a63e86490 None admin] RBAC: Adding query filter params (name=service) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:34.075985 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3807de2-ed98-4501-88df-697a63e86490 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:34.076731 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3807de2-ed98-4501-88df-697a63e86490 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:34.090989 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 296/608] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 9 11:06:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:34.090989 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3807de2-ed98-4501-88df-697a63e86490 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:34.141983 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:34.148075 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:34.157616 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59ee63-c2ac-4539-ba82-00b4a4043a7a None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:34.195077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c557505-fb79-4644-a4b1-b8515dd6de79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:34.195711 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c557505-fb79-4644-a4b1-b8515dd6de79 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:34.195992 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c557505-fb79-4644-a4b1-b8515dd6de79 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:34.196267 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c557505-fb79-4644-a4b1-b8515dd6de79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:34.205507 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3807de2-ed98-4501-88df-697a63e86490 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:34.208236 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c557505-fb79-4644-a4b1-b8515dd6de79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:34.209728 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c557505-fb79-4644-a4b1-b8515dd6de79 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:34.225346 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-2c557505-fb79-4644-a4b1-b8515dd6de79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:34.225346 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:34.225346 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:34.225346 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:34.225346 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:34.225346 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:34.225346 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:34.225346 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:34.225346 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:34.225346 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:34.225346 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:34.225346 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:34.225346 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:34.225346 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:34.225346 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:34.225346 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:34.226447 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:34.226447 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:34.226447 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:34.226447 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:34.226447 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:34.226447 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:34.226447 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:34.226447 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:34.226447 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:34.226447 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:34.226447 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:34.226447 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:34.226447 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:34.226447 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:34.226447 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:34.226447 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:34.226447 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:34.227351 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:34.227351 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:34.227351 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:34.227351 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 313/609] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:34.227351 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c557505-fb79-4644-a4b1-b8515dd6de79 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:34.254577 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd416c-fa27-4196-ba96-356540b33a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:34.255642 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd416c-fa27-4196-ba96-356540b33a62 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:34.256378 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd416c-fa27-4196-ba96-356540b33a62 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:34.256836 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd416c-fa27-4196-ba96-356540b33a62 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:34.257927 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd416c-fa27-4196-ba96-356540b33a62 None admin] RBAC: Adding query filter params (name=service) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:34.258543 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd416c-fa27-4196-ba96-356540b33a62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:34.260703 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd416c-fa27-4196-ba96-356540b33a62 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:34.271629 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 297/610] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 9 11:06:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:34.273029 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd416c-fa27-4196-ba96-356540b33a62 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:34.344285 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c557505-fb79-4644-a4b1-b8515dd6de79 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:34.382569 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d029a1-d0d7-469b-8eb8-4939d361d4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:34.383459 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d029a1-d0d7-469b-8eb8-4939d361d4ad None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:34.383850 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d029a1-d0d7-469b-8eb8-4939d361d4ad None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:34.384307 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d029a1-d0d7-469b-8eb8-4939d361d4ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:34.390847 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd416c-fa27-4196-ba96-356540b33a62 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:34.396981 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d029a1-d0d7-469b-8eb8-4939d361d4ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:34.398445 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d029a1-d0d7-469b-8eb8-4939d361d4ad None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:34.401033 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:34.407344 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:34.414655 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-63d029a1-d0d7-469b-8eb8-4939d361d4ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:34.414655 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:34.414655 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:34.414655 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:34.414655 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:34.414655 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:34.414655 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:34.414655 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:34.414655 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:34.414655 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:34.414655 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:34.414655 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:34.414655 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:34.414655 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:34.414655 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:34.414655 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:34.415658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:34.415658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:34.415658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:34.415658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:34.415658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:34.415658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:34.415658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:34.415658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:34.415658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:34.415658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:34.415658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:34.415658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:34.415658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:34.415658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:34.415658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:34.415658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:34.415658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:34.422876 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:34.422876 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:34.422876 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:34.422876 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 314/611] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:34.422876 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d029a1-d0d7-469b-8eb8-4939d361d4ad None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:34.440314 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488dc6cd-d055-48bb-b16d-42c9d1895ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:34.441402 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dc6cd-d055-48bb-b16d-42c9d1895ece None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:34.441841 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dc6cd-d055-48bb-b16d-42c9d1895ece None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:34.442254 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dc6cd-d055-48bb-b16d-42c9d1895ece None admin] PATH_INFO: `/v3/domains` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:34.442905 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488dc6cd-d055-48bb-b16d-42c9d1895ece None admin] RBAC: Adding query filter params (name=Default) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:34.443378 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488dc6cd-d055-48bb-b16d-42c9d1895ece None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:34.445442 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488dc6cd-d055-48bb-b16d-42c9d1895ece None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:34.465498 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 298/612] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:34.465498 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488dc6cd-d055-48bb-b16d-42c9d1895ece None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:34.525080 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d029a1-d0d7-469b-8eb8-4939d361d4ad None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:34.563432 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaef04b-301d-45e2-b012-6074ebcbd8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:34.564089 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaef04b-301d-45e2-b012-6074ebcbd8c7 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:34.564350 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaef04b-301d-45e2-b012-6074ebcbd8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:34.564624 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaef04b-301d-45e2-b012-6074ebcbd8c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:34.573166 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488dc6cd-d055-48bb-b16d-42c9d1895ece None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:34.576682 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaef04b-301d-45e2-b012-6074ebcbd8c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:34.577942 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaef04b-301d-45e2-b012-6074ebcbd8c7 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:34.592970 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-dbaef04b-301d-45e2-b012-6074ebcbd8c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:34.592970 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:34.592970 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:34.592970 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:34.592970 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:34.592970 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:34.592970 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:34.592970 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:34.592970 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:34.592970 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:34.592970 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:34.592970 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:34.592970 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:34.592970 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:34.592970 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:34.592970 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:34.594038 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:34.594038 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:34.594038 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:34.594038 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:34.594038 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:34.594038 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:34.594038 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:34.594038 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:34.594038 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:34.594038 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:34.594038 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:34.594038 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:34.594038 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:34.594038 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:34.594038 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:34.594038 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:34.594038 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:34.594931 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:34.594931 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:34.594931 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:34.594931 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 315/613] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:34.595589 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaef04b-301d-45e2-b012-6074ebcbd8c7 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:34.615218 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11736023-d69e-474a-b702-de543cc8bf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:34.615832 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11736023-d69e-474a-b702-de543cc8bf8e None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:34.616112 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11736023-d69e-474a-b702-de543cc8bf8e None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:34.616391 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11736023-d69e-474a-b702-de543cc8bf8e None admin] PATH_INFO: `/v3/domains` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:34.617025 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11736023-d69e-474a-b702-de543cc8bf8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:34.617347 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11736023-d69e-474a-b702-de543cc8bf8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:34.618725 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11736023-d69e-474a-b702-de543cc8bf8e None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:34.635154 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 299/614] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:34.635154 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11736023-d69e-474a-b702-de543cc8bf8e None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:34.657464 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:34.671969 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:34.719750 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaef04b-301d-45e2-b012-6074ebcbd8c7 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:34.741662 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11736023-d69e-474a-b702-de543cc8bf8e None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:34.757138 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbcff7e-aece-4ae9-bf0a-cc63512d56e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:34.757816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcff7e-aece-4ae9-bf0a-cc63512d56e7 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:34.758207 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcff7e-aece-4ae9-bf0a-cc63512d56e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:34.758480 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcff7e-aece-4ae9-bf0a-cc63512d56e7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:34.766788 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbcff7e-aece-4ae9-bf0a-cc63512d56e7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:34.768443 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbcff7e-aece-4ae9-bf0a-cc63512d56e7 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:34.775485 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e24694-e8f3-4e90-8c34-5ad24aa97206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:34.776006 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e24694-e8f3-4e90-8c34-5ad24aa97206 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:34.776290 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e24694-e8f3-4e90-8c34-5ad24aa97206 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:34.776562 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e24694-e8f3-4e90-8c34-5ad24aa97206 None admin] PATH_INFO: `/v3/domains` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:34.777206 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e24694-e8f3-4e90-8c34-5ad24aa97206 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:34.777558 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e24694-e8f3-4e90-8c34-5ad24aa97206 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:34.779473 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e24694-e8f3-4e90-8c34-5ad24aa97206 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:34.782746 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-abbcff7e-aece-4ae9-bf0a-cc63512d56e7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 11:06:34.782746 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:34.782746 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:34.782746 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:34.782746 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:34.782746 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:34.782746 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:34.782746 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:34.782746 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:34.782746 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:34.782746 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:34.782746 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:34.782746 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:06:34.782746 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:06:34.782746 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:06:34.782746 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:06:34.784307 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:34.784307 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:34.784307 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:06:34.784307 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:06:34.784307 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:06:34.784307 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:06:34.784307 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:34.784307 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:34.784307 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:34.784307 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:34.784307 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:34.784307 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:34.784307 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:34.784307 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:34.784307 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:34.784307 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:34.784307 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:34.784307 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:34.785480 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:34.785480 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:34.785480 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:06:34.785480 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:06:34.785480 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:06:34.785480 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:06:34.785480 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:06:34.785480 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:06:34.785480 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 11:06:34.785480 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:34.786536 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 316/615] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:06:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:34.787328 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbcff7e-aece-4ae9-bf0a-cc63512d56e7 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:34.797430 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 300/616] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:34.798653 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e24694-e8f3-4e90-8c34-5ad24aa97206 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:34.899381 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbcff7e-aece-4ae9-bf0a-cc63512d56e7 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:34.903492 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:34.910104 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:34.913858 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e24694-e8f3-4e90-8c34-5ad24aa97206 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:34.937374 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6e7ba-a371-417d-bd23-4fed6c936393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:34.938015 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6e7ba-a371-417d-bd23-4fed6c936393 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:34.938298 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6e7ba-a371-417d-bd23-4fed6c936393 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:34.938573 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6e7ba-a371-417d-bd23-4fed6c936393 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:34.946714 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6e7ba-a371-417d-bd23-4fed6c936393 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:34.948159 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6e7ba-a371-417d-bd23-4fed6c936393 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:34.956466 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac6c88-41b6-4f4d-931e-109636d99a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:34.957455 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac6c88-41b6-4f4d-931e-109636d99a48 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:34.957954 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac6c88-41b6-4f4d-931e-109636d99a48 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:34.958426 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac6c88-41b6-4f4d-931e-109636d99a48 None admin] PATH_INFO: `/v3/users` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:34.959362 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac6c88-41b6-4f4d-931e-109636d99a48 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:34.959864 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac6c88-41b6-4f4d-931e-109636d99a48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:34.960544 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-23f6e7ba-a371-417d-bd23-4fed6c936393 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 11:06:34.960544 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:34.960544 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:34.960544 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:34.960544 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:34.960544 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:34.960544 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:34.960544 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:34.960544 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:34.960544 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:34.960544 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:34.960544 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:34.960544 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:06:34.960544 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:06:34.960544 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:06:34.960544 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:06:34.961514 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:34.961514 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:34.961514 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:06:34.961514 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:06:34.961514 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:06:34.961514 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:06:34.961514 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:34.961514 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:34.961514 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:34.961514 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:34.961514 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:34.961514 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:34.961514 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:34.961514 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:34.961514 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:34.961514 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:34.961514 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:34.961514 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:34.967864 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:34.967864 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:34.967864 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:06:34.967864 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:06:34.967864 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:06:34.967864 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:06:34.967864 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:06:34.967864 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:06:34.967864 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 11:06:34.967864 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:34.967864 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 317/617] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 9 11:06:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:34.968455 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac6c88-41b6-4f4d-931e-109636d99a48 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:34.968539 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6e7ba-a371-417d-bd23-4fed6c936393 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:34.984006 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 301/618] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Sep 9 11:06:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:34.985227 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac6c88-41b6-4f4d-931e-109636d99a48 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:35.089427 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6e7ba-a371-417d-bd23-4fed6c936393 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:35.090085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac6c88-41b6-4f4d-931e-109636d99a48 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:35.128373 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9cff8-369b-4baf-9a78-1dcf43edf370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:35.129681 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9cff8-369b-4baf-9a78-1dcf43edf370 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:35.129681 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9cff8-369b-4baf-9a78-1dcf43edf370 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:35.129681 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9cff8-369b-4baf-9a78-1dcf43edf370 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:35.133318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b659b-5d70-4634-b3e4-802a3bf73471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:35.133933 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b659b-5d70-4634-b3e4-802a3bf73471 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:35.134208 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b659b-5d70-4634-b3e4-802a3bf73471 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:35.134474 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b659b-5d70-4634-b3e4-802a3bf73471 None admin] PATH_INFO: `/v3/users` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:35.135197 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b659b-5d70-4634-b3e4-802a3bf73471 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:35.135498 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b659b-5d70-4634-b3e4-802a3bf73471 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:35.137718 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b659b-5d70-4634-b3e4-802a3bf73471 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:35.138552 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9cff8-369b-4baf-9a78-1dcf43edf370 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:35.141176 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9cff8-369b-4baf-9a78-1dcf43edf370 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:35.153777 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-62f9cff8-369b-4baf-9a78-1dcf43edf370 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:06:35.153777 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:35.153777 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:35.153777 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:35.153777 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:35.153777 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:35.153777 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:35.153777 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:35.153777 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:35.153777 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:35.153777 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:35.153777 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:35.153777 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:06:35.153777 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:06:35.153777 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:06:35.153777 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:06:35.154902 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:35.154902 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:35.154902 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:06:35.154902 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:06:35.154902 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:06:35.154902 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:06:35.154902 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:35.154902 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:35.154902 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:35.154902 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:35.154902 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:35.154902 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:35.154902 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:35.154902 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:35.154902 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:35.154902 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:35.154902 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:35.154902 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:35.160934 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:35.160934 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:35.160934 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:06:35.160934 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:06:35.160934 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:06:35.160934 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:06:35.160934 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:06:35.160934 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:06:35.160934 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:06:35.160934 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:35.160934 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 318/619] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:06:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:35.160934 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9cff8-369b-4baf-9a78-1dcf43edf370 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:35.161617 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 302/620] 10.222.0.20 () {56 vars in 1139 bytes} [Fri Sep 9 11:06:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:35.161929 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b659b-5d70-4634-b3e4-802a3bf73471 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:35.174923 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:35.193212 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:35.284220 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b659b-5d70-4634-b3e4-802a3bf73471 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:35.284682 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9cff8-369b-4baf-9a78-1dcf43edf370 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:35.335942 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c2d21-7f90-4d80-9ab8-23b12f3805b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:35.336545 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c2d21-7f90-4d80-9ab8-23b12f3805b1 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:35.336820 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c2d21-7f90-4d80-9ab8-23b12f3805b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:35.337088 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c2d21-7f90-4d80-9ab8-23b12f3805b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:35.353870 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e2683-c318-495b-aeb5-6489cc666f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:35.354375 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e2683-c318-495b-aeb5-6489cc666f28 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:35.354653 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e2683-c318-495b-aeb5-6489cc666f28 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:35.354928 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e2683-c318-495b-aeb5-6489cc666f28 None admin] PATH_INFO: `/v3/users` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:35.355709 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e2683-c318-495b-aeb5-6489cc666f28 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:35.356583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e2683-c318-495b-aeb5-6489cc666f28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:35.358219 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e2683-c318-495b-aeb5-6489cc666f28 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:35.376943 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 303/621] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Sep 9 11:06:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:35.377633 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e2683-c318-495b-aeb5-6489cc666f28 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:35.417612 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c2d21-7f90-4d80-9ab8-23b12f3805b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:35.419872 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c2d21-7f90-4d80-9ab8-23b12f3805b1 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:35.452706 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:35.460055 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:35.491942 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e2683-c318-495b-aeb5-6489cc666f28 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:35.530863 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6b0f2-d269-40fe-855e-8d365f0068f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:35.531266 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6b0f2-d269-40fe-855e-8d365f0068f7 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:35.532081 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6b0f2-d269-40fe-855e-8d365f0068f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:35.532081 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6b0f2-d269-40fe-855e-8d365f0068f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:35.564380 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 319/622] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:06:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:06:35.564380 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c2d21-7f90-4d80-9ab8-23b12f3805b1 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:35.635197 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6b0f2-d269-40fe-855e-8d365f0068f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:35.638266 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6b0f2-d269-40fe-855e-8d365f0068f7 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:35.705367 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c2d21-7f90-4d80-9ab8-23b12f3805b1 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:35.721053 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:35.742349 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:35.754188 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8336c21-c1b8-44ec-8b41-e8fca579e353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:35.754969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8336c21-c1b8-44ec-8b41-e8fca579e353 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:35.755247 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8336c21-c1b8-44ec-8b41-e8fca579e353 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:35.755895 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8336c21-c1b8-44ec-8b41-e8fca579e353 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:35.766159 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 304/623] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:06:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:06:35.766159 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6b0f2-d269-40fe-855e-8d365f0068f7 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:35.845399 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8336c21-c1b8-44ec-8b41-e8fca579e353 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:35.846966 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8336c21-c1b8-44ec-8b41-e8fca579e353 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:35.890795 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6b0f2-d269-40fe-855e-8d365f0068f7 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:35.927804 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dca6ac-0925-4232-8632-6bc91a382d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:35.928430 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dca6ac-0925-4232-8632-6bc91a382d4b None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:35.928718 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dca6ac-0925-4232-8632-6bc91a382d4b None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:35.928986 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dca6ac-0925-4232-8632-6bc91a382d4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:35.940075 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dca6ac-0925-4232-8632-6bc91a382d4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:35.941673 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dca6ac-0925-4232-8632-6bc91a382d4b None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:35.957628 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-b0dca6ac-0925-4232-8632-6bc91a382d4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:35.957628 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:35.957628 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:35.957628 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:35.957628 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:35.957628 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:35.957628 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:35.957628 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:35.957628 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:35.957628 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:35.957628 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:35.957628 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:35.957628 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:35.957628 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:35.957628 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:35.957628 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:35.958643 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:35.958643 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:35.958643 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:35.958643 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:35.958643 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:35.958643 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:35.958643 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:35.958643 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:35.958643 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:35.958643 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:35.958643 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:35.958643 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:35.958643 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:35.958643 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:35.958643 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:35.958643 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:35.958643 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:35.964293 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:35.964293 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:35.964293 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:35.964293 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 305/624] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:35.964293 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dca6ac-0925-4232-8632-6bc91a382d4b None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:35.975442 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 320/625] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:06:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:06:35.976390 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8336c21-c1b8-44ec-8b41-e8fca579e353 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:35.987605 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:36.010650 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:36.097645 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dca6ac-0925-4232-8632-6bc91a382d4b None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:36.113652 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8336c21-c1b8-44ec-8b41-e8fca579e353 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:36.138761 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6dd1d-38be-40b0-b07f-0ec65b520111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:36.139405 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6dd1d-38be-40b0-b07f-0ec65b520111 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:36.139688 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6dd1d-38be-40b0-b07f-0ec65b520111 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:36.139962 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6dd1d-38be-40b0-b07f-0ec65b520111 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:36.152467 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6dd1d-38be-40b0-b07f-0ec65b520111 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:36.154257 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6dd1d-38be-40b0-b07f-0ec65b520111 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:36.157536 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de5332-526e-4a15-a268-707e801bbabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:36.158164 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de5332-526e-4a15-a268-707e801bbabb None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:36.159023 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de5332-526e-4a15-a268-707e801bbabb None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:36.159023 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de5332-526e-4a15-a268-707e801bbabb None admin] PATH_INFO: `/v3/domains` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:36.159388 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de5332-526e-4a15-a268-707e801bbabb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:36.159631 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de5332-526e-4a15-a268-707e801bbabb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:36.161392 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de5332-526e-4a15-a268-707e801bbabb None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:36.175302 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-2dc6dd1d-38be-40b0-b07f-0ec65b520111 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:36.175302 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:36.175302 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:36.175302 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:36.175302 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:36.175302 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:36.175302 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:36.175302 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:36.175302 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:36.175302 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:36.175302 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:36.175302 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:36.175302 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:36.175302 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:36.175302 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:36.175302 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:36.181143 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:36.181143 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:36.181143 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:36.181143 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:36.181143 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:36.181143 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:36.181143 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:36.181143 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:36.181143 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:36.181143 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:36.181143 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:36.181143 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:36.181143 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:36.181143 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:36.181143 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:36.181143 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:36.181143 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:36.182424 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:36.182424 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:36.182424 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:36.182595 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 321/626] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:36.182595 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de5332-526e-4a15-a268-707e801bbabb None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:36.182734 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 306/627] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:36.182734 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6dd1d-38be-40b0-b07f-0ec65b520111 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:36.271562 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:36.305775 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:36.308243 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6dd1d-38be-40b0-b07f-0ec65b520111 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:36.320067 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de5332-526e-4a15-a268-707e801bbabb None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:36.360794 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8509c-d43c-4868-81e5-2532d895bbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:36.360794 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8509c-d43c-4868-81e5-2532d895bbaf None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:36.360794 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8509c-d43c-4868-81e5-2532d895bbaf None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:36.360794 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8509c-d43c-4868-81e5-2532d895bbaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:36.368722 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8509c-d43c-4868-81e5-2532d895bbaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:36.370224 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8509c-d43c-4868-81e5-2532d895bbaf None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:36.372990 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4f88e-e94f-426c-855d-2e5eefd7298f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:36.373679 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4f88e-e94f-426c-855d-2e5eefd7298f None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:36.373965 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4f88e-e94f-426c-855d-2e5eefd7298f None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:36.374304 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4f88e-e94f-426c-855d-2e5eefd7298f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:36.383103 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-a1f8509c-d43c-4868-81e5-2532d895bbaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:06:36.383103 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:36.383103 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:36.383103 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:36.383103 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:36.383103 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:36.383103 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:36.383103 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:36.383103 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:36.383103 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:36.383103 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:36.383103 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:36.383103 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:06:36.383103 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:06:36.383103 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:06:36.384094 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:06:36.384094 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:36.384094 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:36.384094 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:36.384094 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:36.384094 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:36.384094 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:36.384094 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:36.384094 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:36.384094 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:36.384094 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:36.384094 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:36.384094 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:36.384094 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:36.384094 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:36.384094 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:36.384094 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:36.385013 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:06:36.385013 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:06:36.385013 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:06:36.385013 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:06:36.385013 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:06:36.385013 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:06:36.385013 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:06:36.385013 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:36.385013 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 307/628] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:06:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:36.385013 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8509c-d43c-4868-81e5-2532d895bbaf None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:36.388251 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4f88e-e94f-426c-855d-2e5eefd7298f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:36.390307 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4f88e-e94f-426c-855d-2e5eefd7298f None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:36.408236 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-5ba4f88e-e94f-426c-855d-2e5eefd7298f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:36.408236 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:36.408236 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:36.408236 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:36.408236 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:36.408236 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:36.408236 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:36.408236 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:36.408236 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:36.408236 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:36.408236 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:36.408236 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:36.408236 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:36.408236 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:36.408236 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:36.408236 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:36.409396 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:36.409396 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:36.409396 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:36.409396 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:36.409396 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:36.409396 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:36.409396 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:36.409396 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:36.409396 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:36.409396 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:36.409396 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:36.409396 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:36.409396 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:36.409396 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:36.409396 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:36.409396 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:36.409396 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:36.410507 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:36.410507 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:36.410507 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:36.410507 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 322/629] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:36.410507 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22613b6f-1dcd-41e8-89bb-0b942113cda4 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:36.410507 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22613b6f-1dcd-41e8-89bb-0b942113cda4 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:36.410507 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22613b6f-1dcd-41e8-89bb-0b942113cda4 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:36.415955 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 323/630] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:36.415955 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22613b6f-1dcd-41e8-89bb-0b942113cda4 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:36.502819 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8509c-d43c-4868-81e5-2532d895bbaf None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:36.524104 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22613b6f-1dcd-41e8-89bb-0b942113cda4 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:36.532172 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:36.539808 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677d8a5-17af-4de4-9d59-1fb61a58e61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:36.540442 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677d8a5-17af-4de4-9d59-1fb61a58e61c None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:36.540725 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677d8a5-17af-4de4-9d59-1fb61a58e61c None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:36.541002 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677d8a5-17af-4de4-9d59-1fb61a58e61c None admin] PATH_INFO: `/v3/domains` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:36.541687 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677d8a5-17af-4de4-9d59-1fb61a58e61c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:36.541997 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677d8a5-17af-4de4-9d59-1fb61a58e61c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:36.543389 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677d8a5-17af-4de4-9d59-1fb61a58e61c None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:36.557862 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 308/631] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:36.558929 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677d8a5-17af-4de4-9d59-1fb61a58e61c None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:36.563833 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956d87a-8d4e-4888-90fb-0386daf91728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:36.564439 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956d87a-8d4e-4888-90fb-0386daf91728 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:36.564720 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956d87a-8d4e-4888-90fb-0386daf91728 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:36.565002 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956d87a-8d4e-4888-90fb-0386daf91728 None admin] PATH_INFO: `/v3/projects` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:36.565730 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956d87a-8d4e-4888-90fb-0386daf91728 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:36.566036 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956d87a-8d4e-4888-90fb-0386daf91728 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:36.567492 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956d87a-8d4e-4888-90fb-0386daf91728 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:36.577887 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:36.581359 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 324/632] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 9 11:06:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:36.582704 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c44f0a-3b41-4b63-b9a4-415f317403be None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:36.584389 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c44f0a-3b41-4b63-b9a4-415f317403be None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:36.584788 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c44f0a-3b41-4b63-b9a4-415f317403be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:36.603687 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-95c44f0a-3b41-4b63-b9a4-415f317403be None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:36.604904 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-95c44f0a-3b41-4b63-b9a4-415f317403be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:36.674413 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677d8a5-17af-4de4-9d59-1fb61a58e61c None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:36.677800 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 325/633] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:06:36.678818 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c44f0a-3b41-4b63-b9a4-415f317403be None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:36.714559 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21fa75-53e8-423f-ab3b-dab393246a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:36.715183 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21fa75-53e8-423f-ab3b-dab393246a1b None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:36.715994 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21fa75-53e8-423f-ab3b-dab393246a1b None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:36.716269 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21fa75-53e8-423f-ab3b-dab393246a1b None admin] PATH_INFO: `/v3/domains` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:36.716915 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21fa75-53e8-423f-ab3b-dab393246a1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:36.717219 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21fa75-53e8-423f-ab3b-dab393246a1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:36.718660 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21fa75-53e8-423f-ab3b-dab393246a1b None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:36.730827 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 309/634] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:36.731879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21fa75-53e8-423f-ab3b-dab393246a1b None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:36.795103 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:36.804767 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c44f0a-3b41-4b63-b9a4-415f317403be None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:36.837848 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:36.844941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a9007-c440-40cf-be4a-341a040d563c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:36.845876 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a9007-c440-40cf-be4a-341a040d563c None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:36.846978 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a9007-c440-40cf-be4a-341a040d563c None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:36.847456 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a9007-c440-40cf-be4a-341a040d563c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:36.855703 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a9007-c440-40cf-be4a-341a040d563c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:36.857944 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a9007-c440-40cf-be4a-341a040d563c None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:36.866328 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21fa75-53e8-423f-ab3b-dab393246a1b None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:36.870315 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-821a9007-c440-40cf-be4a-341a040d563c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:06:36.870315 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:36.870315 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:36.870315 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:36.870315 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:36.870315 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:36.870315 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:36.870315 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:36.870315 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:36.870315 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:36.870315 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:36.870315 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:36.870315 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:06:36.870315 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:06:36.870315 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:06:36.871225 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:06:36.871225 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:36.871225 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:36.871225 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:36.871225 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:36.871225 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:36.871225 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:36.871225 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:36.871225 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:36.871225 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:36.871225 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:36.871225 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:36.871225 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:36.871225 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:36.871225 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:36.871225 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:36.871225 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:36.872816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:06:36.872816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:06:36.872816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:06:36.872816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:06:36.872816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:06:36.872816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:06:36.872816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:06:36.872816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:36.876833 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 326/635] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:06:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:36.877766 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a9007-c440-40cf-be4a-341a040d563c None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:36.906371 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6e149-75ec-487b-934e-9eeac036778c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:36.907080 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6e149-75ec-487b-934e-9eeac036778c None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:36.907366 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6e149-75ec-487b-934e-9eeac036778c None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:36.907626 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6e149-75ec-487b-934e-9eeac036778c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:36.908452 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6e149-75ec-487b-934e-9eeac036778c None admin] RBAC: Adding query filter params (role.id=d2efb827d8084d99971bbe82cfa142e2, scope.project.id=b9cec15abcd74e13ba458c64ad6fdf9b, user.id=9d2e6375358545ac80db469ea4c2deb1) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:36.908755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6e149-75ec-487b-934e-9eeac036778c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:36.910191 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6e149-75ec-487b-934e-9eeac036778c None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:36.925403 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 310/636] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:06:36 2022] GET /identity/v3/role_assignments?user.id=9d2e6375358545ac80db469ea4c2deb1&scope.project.id=b9cec15abcd74e13ba458c64ad6fdf9b&role.id=d2efb827d8084d99971bbe82cfa142e2 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:36.925403 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6e149-75ec-487b-934e-9eeac036778c None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:37.021378 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a9007-c440-40cf-be4a-341a040d563c None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:37.062670 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6e149-75ec-487b-934e-9eeac036778c None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:37.081456 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2d8a6-e47a-4961-a1d3-03307d2e198d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:37.082514 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2d8a6-e47a-4961-a1d3-03307d2e198d None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:37.082975 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2d8a6-e47a-4961-a1d3-03307d2e198d None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:37.083421 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2d8a6-e47a-4961-a1d3-03307d2e198d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:37.085543 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:37.097020 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2d8a6-e47a-4961-a1d3-03307d2e198d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:37.099219 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2d8a6-e47a-4961-a1d3-03307d2e198d None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:37.119001 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-c7d2d8a6-e47a-4961-a1d3-03307d2e198d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:06:37.119001 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:37.119001 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:37.119001 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:37.119001 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:37.119001 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:37.119001 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:37.119001 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:37.119001 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:37.119001 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:37.119001 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:37.119001 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:37.119001 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:06:37.119001 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:06:37.119001 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:06:37.120811 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:06:37.120811 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:37.120811 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:37.120811 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:37.120811 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:37.120811 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:37.120811 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:37.120811 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:37.120811 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:37.120811 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:37.120811 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:37.120811 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:37.120811 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:37.120811 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:37.120811 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:37.120811 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:37.120811 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:37.125075 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:06:37.125075 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:06:37.125075 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:06:37.125075 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:06:37.125075 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:06:37.125075 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:06:37.125075 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:06:37.125075 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:37.125075 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 327/637] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:06:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:37.125075 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2d8a6-e47a-4961-a1d3-03307d2e198d None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:37.139164 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd215f-fa93-4dee-825c-857e3cb497dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:37.139795 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd215f-fa93-4dee-825c-857e3cb497dd None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:37.140070 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd215f-fa93-4dee-825c-857e3cb497dd None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:37.140339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd215f-fa93-4dee-825c-857e3cb497dd None admin] PATH_INFO: `/v3/projects` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:37.141045 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd215f-fa93-4dee-825c-857e3cb497dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:37.141379 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd215f-fa93-4dee-825c-857e3cb497dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:37.142854 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd215f-fa93-4dee-825c-857e3cb497dd None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:37.157266 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 311/638] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 9 11:06:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:37.157266 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd215f-fa93-4dee-825c-857e3cb497dd None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:37.201173 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:37.264345 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2d8a6-e47a-4961-a1d3-03307d2e198d None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:37.289147 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd215f-fa93-4dee-825c-857e3cb497dd None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:37.311838 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcbe25-6e50-4381-94db-4a04eff2ad2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:37.312579 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcbe25-6e50-4381-94db-4a04eff2ad2a None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:37.312930 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcbe25-6e50-4381-94db-4a04eff2ad2a None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:37.313274 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcbe25-6e50-4381-94db-4a04eff2ad2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:37.330598 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fcbe25-6e50-4381-94db-4a04eff2ad2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:06:37.336694 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8b5f4-ea04-4456-910c-9fe0c97c29d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:37.337257 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-f0fcbe25-6e50-4381-94db-4a04eff2ad2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:06:37.337257 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:37.337257 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:37.337257 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:37.337257 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:37.337257 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:37.337257 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:37.337257 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:37.337257 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:37.337257 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:37.337257 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:37.337257 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:37.337257 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:06:37.337257 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:06:37.337257 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:06:37.337257 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:06:37.339029 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:06:37.339029 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:06:37.339029 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:06:37.339029 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:06:37.339029 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:37.339029 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:37.339029 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:37.339029 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:37.339029 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:37.339029 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:37.339029 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:37.339029 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:37.339029 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:37.339029 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:37.339029 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:37.339029 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:37.342137 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:37.342137 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:37.342137 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:37.342137 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:37.342137 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:06:37.342137 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:06:37.342137 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:06:37.342137 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:06:37.342137 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:06:37.342137 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:06:37.342137 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:06:37.342137 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:37.342885 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8b5f4-ea04-4456-910c-9fe0c97c29d6 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:37.342885 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8b5f4-ea04-4456-910c-9fe0c97c29d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:37.342885 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8b5f4-ea04-4456-910c-9fe0c97c29d6 None admin] PATH_INFO: `/v3/projects` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:37.342885 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8b5f4-ea04-4456-910c-9fe0c97c29d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:37.342885 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8b5f4-ea04-4456-910c-9fe0c97c29d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:37.342885 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8b5f4-ea04-4456-910c-9fe0c97c29d6 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:37.345085 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 328/639] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 9 11:06:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:37.346511 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcbe25-6e50-4381-94db-4a04eff2ad2a None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:37.362384 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 312/640] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 9 11:06:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:37.362384 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8b5f4-ea04-4456-910c-9fe0c97c29d6 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:37.399934 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:37.479715 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcbe25-6e50-4381-94db-4a04eff2ad2a None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:37.486449 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8b5f4-ea04-4456-910c-9fe0c97c29d6 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:37.498198 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:37.528489 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973fb96-b032-41c2-b6b1-beebf3392033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:37.528745 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973fb96-b032-41c2-b6b1-beebf3392033 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:37.529103 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973fb96-b032-41c2-b6b1-beebf3392033 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:37.529476 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973fb96-b032-41c2-b6b1-beebf3392033 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:37.530286 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973fb96-b032-41c2-b6b1-beebf3392033 None admin] RBAC: Adding query filter params (role.id=d2efb827d8084d99971bbe82cfa142e2, scope.project.id=b9cec15abcd74e13ba458c64ad6fdf9b, user.id=1693fd5ca6084609adcb148aa7d7a8d6) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:37.530669 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973fb96-b032-41c2-b6b1-beebf3392033 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:37.532334 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973fb96-b032-41c2-b6b1-beebf3392033 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:37.535097 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a3c36-e138-4d55-9bd1-93772ebf33ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:37.535811 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a3c36-e138-4d55-9bd1-93772ebf33ae None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:37.536168 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a3c36-e138-4d55-9bd1-93772ebf33ae None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:37.536508 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a3c36-e138-4d55-9bd1-93772ebf33ae None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:37.537335 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a3c36-e138-4d55-9bd1-93772ebf33ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:37.537712 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a3c36-e138-4d55-9bd1-93772ebf33ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:37.539156 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a3c36-e138-4d55-9bd1-93772ebf33ae None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:37.549727 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 329/641] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:06:37 2022] GET /identity/v3/role_assignments?user.id=1693fd5ca6084609adcb148aa7d7a8d6&scope.project.id=b9cec15abcd74e13ba458c64ad6fdf9b&role.id=d2efb827d8084d99971bbe82cfa142e2 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:37.549727 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973fb96-b032-41c2-b6b1-beebf3392033 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:37.558980 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 313/642] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:06:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:37.567329 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a3c36-e138-4d55-9bd1-93772ebf33ae None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:37.690265 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973fb96-b032-41c2-b6b1-beebf3392033 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:37.710574 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:37.726158 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a3c36-e138-4d55-9bd1-93772ebf33ae None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:37.751177 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0fcb1-057f-4d3d-ba5a-77a657612ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:37.752187 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0fcb1-057f-4d3d-ba5a-77a657612ceb None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:37.752750 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0fcb1-057f-4d3d-ba5a-77a657612ceb None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:37.753306 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0fcb1-057f-4d3d-ba5a-77a657612ceb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:37.754579 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f0fcb1-057f-4d3d-ba5a-77a657612ceb None admin] RBAC: Adding query filter params (role.id=d2efb827d8084d99971bbe82cfa142e2, scope.project.id=b9cec15abcd74e13ba458c64ad6fdf9b, user.id=c779e851ccf2438594c450eb479c7717) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:37.755173 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f0fcb1-057f-4d3d-ba5a-77a657612ceb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:37.757887 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f0fcb1-057f-4d3d-ba5a-77a657612ceb None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:37.773804 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 330/643] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:06:37 2022] GET /identity/v3/role_assignments?user.id=c779e851ccf2438594c450eb479c7717&scope.project.id=b9cec15abcd74e13ba458c64ad6fdf9b&role.id=d2efb827d8084d99971bbe82cfa142e2 => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:37.798738 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551815f-d887-4ddc-a167-1079c1d8ed10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:37.799855 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551815f-d887-4ddc-a167-1079c1d8ed10 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:37.800424 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551815f-d887-4ddc-a167-1079c1d8ed10 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:37.801060 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551815f-d887-4ddc-a167-1079c1d8ed10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:37.821830 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551815f-d887-4ddc-a167-1079c1d8ed10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:37.824219 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551815f-d887-4ddc-a167-1079c1d8ed10 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:37.850303 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-1551815f-d887-4ddc-a167-1079c1d8ed10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:37.850303 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:37.850303 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:37.850303 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:37.850303 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:37.850303 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:37.850303 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:37.850303 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:37.850303 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:37.850303 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:37.850303 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:37.850303 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:37.850303 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:37.850303 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:37.850303 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:37.850303 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:37.851318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:37.851318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:37.851318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:37.851318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:37.851318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:37.851318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:37.851318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:37.851318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:37.851318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:37.851318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:37.851318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:37.851318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:37.851318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:37.851318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:37.851318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:37.851318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:37.851318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:37.852242 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:37.852242 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:37.852242 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:37.852887 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 314/644] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:06:37.861402 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0fcb1-057f-4d3d-ba5a-77a657612ceb None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:37.921457 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:37.995815 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0fcb1-057f-4d3d-ba5a-77a657612ceb None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:38.036614 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e0adc-a246-45e9-b411-7b56a2a783bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:38.037423 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e0adc-a246-45e9-b411-7b56a2a783bd None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:38.037981 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e0adc-a246-45e9-b411-7b56a2a783bd None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:38.038452 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e0adc-a246-45e9-b411-7b56a2a783bd None admin] PATH_INFO: `/v3/domains` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:38.039657 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e0adc-a246-45e9-b411-7b56a2a783bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:38.040145 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e0adc-a246-45e9-b411-7b56a2a783bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:38.042896 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e0adc-a246-45e9-b411-7b56a2a783bd None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:38.062291 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 331/645] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:38.070676 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551815f-d887-4ddc-a167-1079c1d8ed10 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:38.215124 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551815f-d887-4ddc-a167-1079c1d8ed10 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:38.252683 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850c93b-ef1a-4db2-badc-0740c1fb2bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:38.253369 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850c93b-ef1a-4db2-badc-0740c1fb2bd7 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:38.253656 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850c93b-ef1a-4db2-badc-0740c1fb2bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:38.253935 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850c93b-ef1a-4db2-badc-0740c1fb2bd7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:38.263106 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850c93b-ef1a-4db2-badc-0740c1fb2bd7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:38.264570 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850c93b-ef1a-4db2-badc-0740c1fb2bd7 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:38.277099 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-9850c93b-ef1a-4db2-badc-0740c1fb2bd7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:06:38.277099 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:38.277099 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:38.277099 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:38.277099 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:38.277099 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:38.277099 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:38.277099 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:38.277099 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:38.277099 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:38.277099 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:38.277099 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:38.277099 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:06:38.277099 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:06:38.277099 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:06:38.277099 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:06:38.278407 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:38.278407 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:38.278407 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:06:38.278407 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:06:38.278407 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:06:38.278407 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:06:38.278407 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:38.278407 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:38.278407 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:38.278407 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:38.278407 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:38.278407 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:38.278407 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:38.278407 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:38.278407 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:38.278407 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:38.278407 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:38.278407 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:38.279500 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:38.279500 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:38.279500 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:06:38.279500 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:06:38.279500 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:06:38.279500 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:06:38.279500 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:06:38.279500 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:06:38.279500 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:06:38.279500 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:38.279500 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 315/646] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 9 11:06:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:38.284035 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e0adc-a246-45e9-b411-7b56a2a783bd None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:38.393976 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:38.397725 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e0adc-a246-45e9-b411-7b56a2a783bd None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:38.435191 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75257143-17b1-4795-914a-edfb73582dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:38.435900 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75257143-17b1-4795-914a-edfb73582dab None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:38.436243 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75257143-17b1-4795-914a-edfb73582dab None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:38.436577 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75257143-17b1-4795-914a-edfb73582dab None admin] PATH_INFO: `/v3/users` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:38.437446 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75257143-17b1-4795-914a-edfb73582dab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:38.437822 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75257143-17b1-4795-914a-edfb73582dab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:38.439410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75257143-17b1-4795-914a-edfb73582dab None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:38.463509 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 332/647] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 9 11:06:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:38.464591 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850c93b-ef1a-4db2-badc-0740c1fb2bd7 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:38.481652 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:38.582774 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850c93b-ef1a-4db2-badc-0740c1fb2bd7 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:38.620416 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2c655-eea2-4bee-8260-2f562e9480b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:38.621119 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2c655-eea2-4bee-8260-2f562e9480b8 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:38.622116 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2c655-eea2-4bee-8260-2f562e9480b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:38.622456 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2c655-eea2-4bee-8260-2f562e9480b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:38.704014 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2c655-eea2-4bee-8260-2f562e9480b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:38.705491 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2c655-eea2-4bee-8260-2f562e9480b8 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:38.715968 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:38.811913 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 316/648] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:06:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 11:06:38.817205 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75257143-17b1-4795-914a-edfb73582dab None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:38.938853 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75257143-17b1-4795-914a-edfb73582dab None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:38.975554 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89a61e-4d8f-4e4d-8886-7e1594c5412d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:38.976186 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89a61e-4d8f-4e4d-8886-7e1594c5412d None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:38.976465 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89a61e-4d8f-4e4d-8886-7e1594c5412d None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:38.976739 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89a61e-4d8f-4e4d-8886-7e1594c5412d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:38.987653 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89a61e-4d8f-4e4d-8886-7e1594c5412d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:38.989110 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89a61e-4d8f-4e4d-8886-7e1594c5412d None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:39.004463 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-9c89a61e-4d8f-4e4d-8886-7e1594c5412d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:39.004463 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:39.004463 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:39.004463 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:39.004463 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:39.004463 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:39.004463 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:39.004463 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:39.004463 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:39.004463 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:39.004463 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:39.004463 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:39.004463 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:39.004463 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:39.004463 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:39.004463 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:39.005473 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:39.005473 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:39.005473 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:39.005473 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:39.005473 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:39.005473 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:39.005473 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:39.005473 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:39.005473 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:39.005473 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:39.005473 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:39.005473 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:39.005473 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:39.005473 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:39.005473 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:39.005473 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:39.005473 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:39.006391 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:39.006391 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:39.006391 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:39.006391 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 333/649] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:39.014388 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2c655-eea2-4bee-8260-2f562e9480b8 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:39.122234 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2c655-eea2-4bee-8260-2f562e9480b8 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:39.133494 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:39.164598 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779eaebd-6264-4405-9c79-074f829274bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:39.165226 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eaebd-6264-4405-9c79-074f829274bd None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:39.165540 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eaebd-6264-4405-9c79-074f829274bd None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:39.165818 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eaebd-6264-4405-9c79-074f829274bd None admin] PATH_INFO: `/v3/domains` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:39.166472 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779eaebd-6264-4405-9c79-074f829274bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:39.166775 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779eaebd-6264-4405-9c79-074f829274bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:39.168152 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779eaebd-6264-4405-9c79-074f829274bd None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:39.182194 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 317/650] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:39.189525 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89a61e-4d8f-4e4d-8886-7e1594c5412d None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:39.202530 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:39.309308 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89a61e-4d8f-4e4d-8886-7e1594c5412d None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:39.339365 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384806b4-46d8-471d-b9d8-a888b7b62c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:39.339995 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384806b4-46d8-471d-b9d8-a888b7b62c0f None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:39.340818 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384806b4-46d8-471d-b9d8-a888b7b62c0f None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:39.341069 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384806b4-46d8-471d-b9d8-a888b7b62c0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:39.348220 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384806b4-46d8-471d-b9d8-a888b7b62c0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:39.349700 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384806b4-46d8-471d-b9d8-a888b7b62c0f None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:39.362172 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-384806b4-46d8-471d-b9d8-a888b7b62c0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:06:39.362172 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:39.362172 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:39.362172 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:39.362172 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:39.362172 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:39.362172 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:39.362172 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:39.362172 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:39.362172 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:39.362172 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:39.362172 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:39.362172 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:06:39.362172 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:06:39.362172 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:06:39.363094 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:06:39.363094 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:39.363094 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:39.363094 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:39.363094 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:39.363094 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:39.363094 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:39.363094 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:39.363094 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:39.363094 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:39.363094 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:39.363094 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:39.363094 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:39.363094 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:39.363094 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:39.363094 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:39.363094 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:39.363997 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:06:39.363997 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:06:39.363997 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:06:39.363997 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:06:39.363997 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:06:39.363997 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:06:39.363997 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:06:39.363997 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:39.363997 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 334/651] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:06:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:39.370747 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779eaebd-6264-4405-9c79-074f829274bd None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:39.475115 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779eaebd-6264-4405-9c79-074f829274bd None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:39.514546 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6658d13-1235-4321-9e80-8b5404e9e89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:39.515165 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6658d13-1235-4321-9e80-8b5404e9e89b None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:39.515448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6658d13-1235-4321-9e80-8b5404e9e89b None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:39.515721 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6658d13-1235-4321-9e80-8b5404e9e89b None admin] PATH_INFO: `/v3/projects` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:39.516406 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6658d13-1235-4321-9e80-8b5404e9e89b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:39.516713 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6658d13-1235-4321-9e80-8b5404e9e89b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:39.518172 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6658d13-1235-4321-9e80-8b5404e9e89b None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:39.532197 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 318/652] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 9 11:06:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:39.538407 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384806b4-46d8-471d-b9d8-a888b7b62c0f None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:39.611707 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33743dc-74c2-4ba5-aa0b-95f6e9149208 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:39.612044 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33743dc-74c2-4ba5-aa0b-95f6e9149208 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:39.612268 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33743dc-74c2-4ba5-aa0b-95f6e9149208 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:39.613993 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 319/653] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:06:39.621736 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e573249-ceb8-45bf-897e-e61de211f640 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:39.622076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e573249-ceb8-45bf-897e-e61de211f640 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:39.622294 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e573249-ceb8-45bf-897e-e61de211f640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:39.630897 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:39.643398 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-6e573249-ceb8-45bf-897e-e61de211f640 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:39.644629 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-6e573249-ceb8-45bf-897e-e61de211f640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:39.676698 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:39.679848 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384806b4-46d8-471d-b9d8-a888b7b62c0f None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:39.738153 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4537b48-0c24-4507-9dc7-3c417ec328a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:39.739867 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4537b48-0c24-4507-9dc7-3c417ec328a4 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:39.740593 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4537b48-0c24-4507-9dc7-3c417ec328a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:39.741694 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4537b48-0c24-4507-9dc7-3c417ec328a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:39.743820 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4537b48-0c24-4507-9dc7-3c417ec328a4 None admin] RBAC: Adding query filter params (role.id=b02ba8c157bf46f4a75cdab917db78db, scope.project.id=b9cec15abcd74e13ba458c64ad6fdf9b, user.id=417acfbae1244469961371115a42498e) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:39.744886 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4537b48-0c24-4507-9dc7-3c417ec328a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:39.748039 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4537b48-0c24-4507-9dc7-3c417ec328a4 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:39.757009 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 320/654] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:06:39.758895 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 335/655] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:06:39 2022] GET /identity/v3/role_assignments?user.id=417acfbae1244469961371115a42498e&scope.project.id=b9cec15abcd74e13ba458c64ad6fdf9b&role.id=b02ba8c157bf46f4a75cdab917db78db => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:40.101400 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e573249-ceb8-45bf-897e-e61de211f640 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:40.213828 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e573249-ceb8-45bf-897e-e61de211f640 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:40.250695 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3f5d8-6571-4825-bdf4-29b454b45275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:40.251328 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3f5d8-6571-4825-bdf4-29b454b45275 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:40.251598 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3f5d8-6571-4825-bdf4-29b454b45275 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:40.251865 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3f5d8-6571-4825-bdf4-29b454b45275 None admin] PATH_INFO: `/v3/services/image` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:40.252442 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3f5d8-6571-4825-bdf4-29b454b45275 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:40.253855 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3f5d8-6571-4825-bdf4-29b454b45275 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:40.265057 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-3ff3f5d8-6571-4825-bdf4-29b454b45275 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 11:06:40.265057 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:40.265057 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:06:40.265057 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:06:40.265057 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:06:40.265057 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:06:40.265057 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:06:40.265057 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:06:40.265057 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 11:06:40.265057 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:40.265057 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:06:40.265057 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:40.265057 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:40.265057 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:40.265057 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:40.265057 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:40.265057 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:40.266232 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:40.266232 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:40.266232 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:40.266232 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:40.266232 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:40.266232 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:40.266232 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:06:40.266232 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:06:40.266232 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:06:40.266232 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:06:40.266232 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:40.266232 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:40.266232 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:40.266232 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:40.266232 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:40.266232 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:40.267311 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:40.267311 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:40.267311 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:40.267311 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:40.267311 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:40.267311 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:40.267311 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:40.267311 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:40.267311 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:40.267311 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:40.267311 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:06:40.267311 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:06:40.267311 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 11:06:40.267311 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:40.267311 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 321/656] 10.222.0.20 () {56 vars in 1105 bytes} [Fri Sep 9 11:06:40 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:40.274560 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4537b48-0c24-4507-9dc7-3c417ec328a4 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:40.319594 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad2bc6-fbb9-4e87-9ecb-f882830b6593 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:40.319880 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad2bc6-fbb9-4e87-9ecb-f882830b6593 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:40.320151 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad2bc6-fbb9-4e87-9ecb-f882830b6593 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:40.322183 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 322/657] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:40.327884 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d9dcb-b466-451f-aca8-cc842361e587 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:40.328172 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d9dcb-b466-451f-aca8-cc842361e587 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:40.328445 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d9dcb-b466-451f-aca8-cc842361e587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:40.348463 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-0c6d9dcb-b466-451f-aca8-cc842361e587 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:40.349896 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-0c6d9dcb-b466-451f-aca8-cc842361e587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:40.369596 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:40.420464 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4537b48-0c24-4507-9dc7-3c417ec328a4 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:40.436718 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 323/658] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:06:40.452923 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:40.458267 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba8130-dca2-46cb-8da5-50f9a86d03b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:40.458913 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba8130-dca2-46cb-8da5-50f9a86d03b4 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:40.459193 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba8130-dca2-46cb-8da5-50f9a86d03b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:40.459468 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba8130-dca2-46cb-8da5-50f9a86d03b4 None admin] PATH_INFO: `/v3/services` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:40.460506 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba8130-dca2-46cb-8da5-50f9a86d03b4 None admin] RBAC: Adding query filter params (name=image) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:40.461074 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba8130-dca2-46cb-8da5-50f9a86d03b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:40.462988 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba8130-dca2-46cb-8da5-50f9a86d03b4 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:40.468795 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 336/659] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:40.474523 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d9dcb-b466-451f-aca8-cc842361e587 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:40.493522 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025ee32-633d-4bf7-8ef7-ca97897c5cec None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:40.493876 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025ee32-633d-4bf7-8ef7-ca97897c5cec None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:40.494083 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025ee32-633d-4bf7-8ef7-ca97897c5cec None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:40.495682 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 337/660] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:40.501107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402beb8d-589b-4f0e-8dd7-3adebff63502 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:40.501426 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402beb8d-589b-4f0e-8dd7-3adebff63502 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:40.501697 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402beb8d-589b-4f0e-8dd7-3adebff63502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:40.521645 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-402beb8d-589b-4f0e-8dd7-3adebff63502 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:40.522871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-402beb8d-589b-4f0e-8dd7-3adebff63502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:40.602312 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d9dcb-b466-451f-aca8-cc842361e587 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:40.605430 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 338/661] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:06:40.638099 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edbc38-bd8f-4141-9241-1f1d9a740bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:40.638625 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edbc38-bd8f-4141-9241-1f1d9a740bad None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:40.638899 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edbc38-bd8f-4141-9241-1f1d9a740bad None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:40.639162 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edbc38-bd8f-4141-9241-1f1d9a740bad None admin] PATH_INFO: `/v3/services` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:40.639782 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94edbc38-bd8f-4141-9241-1f1d9a740bad None admin] RBAC: Adding query filter params (type=image) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:40.640076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94edbc38-bd8f-4141-9241-1f1d9a740bad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:40.641480 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94edbc38-bd8f-4141-9241-1f1d9a740bad None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:40.647710 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 324/662] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:40 2022] GET /identity/v3/services?type=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:40.770332 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402beb8d-589b-4f0e-8dd7-3adebff63502 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:40.885408 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402beb8d-589b-4f0e-8dd7-3adebff63502 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:40.914720 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:40.925462 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4250ad2-e06b-4bbb-931f-a2734a4f201c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:40.926093 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4250ad2-e06b-4bbb-931f-a2734a4f201c None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:40.926368 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4250ad2-e06b-4bbb-931f-a2734a4f201c None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:40.926634 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4250ad2-e06b-4bbb-931f-a2734a4f201c None admin] PATH_INFO: `/v3/services/network` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:40.927269 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4250ad2-e06b-4bbb-931f-a2734a4f201c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:40.928700 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4250ad2-e06b-4bbb-931f-a2734a4f201c None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:40.940483 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-c4250ad2-e06b-4bbb-931f-a2734a4f201c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:06:40.940483 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:40.940483 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:06:40.940483 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:06:40.940483 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:06:40.940483 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:06:40.940483 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:06:40.940483 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:06:40.940483 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:06:40.940483 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:40.940483 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:06:40.940483 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:40.940483 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:40.940483 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:40.940483 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:40.940483 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:40.940483 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:40.942948 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:40.942948 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:40.942948 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:40.942948 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:40.942948 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:40.942948 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:40.942948 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:06:40.942948 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:06:40.942948 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:06:40.942948 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:06:40.942948 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:40.942948 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:40.942948 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:40.942948 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:40.942948 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:40.942948 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:40.944905 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:40.944905 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:40.944905 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:40.944905 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:40.944905 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:40.944905 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:40.944905 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:40.944905 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:40.944905 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:40.944905 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:40.944905 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:06:40.944905 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:06:40.944905 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:06:40.944905 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:40.946693 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edbc38-bd8f-4141-9241-1f1d9a740bad None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:40.947172 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 339/663] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:06:40 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:40.947679 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4250ad2-e06b-4bbb-931f-a2734a4f201c None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:40.973709 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:41.057578 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edbc38-bd8f-4141-9241-1f1d9a740bad None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:41.083572 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4250ad2-e06b-4bbb-931f-a2734a4f201c None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:41.096330 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd2939-64e8-4c6c-886d-3968cc2085e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:41.097010 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd2939-64e8-4c6c-886d-3968cc2085e4 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:41.097313 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd2939-64e8-4c6c-886d-3968cc2085e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:41.097582 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd2939-64e8-4c6c-886d-3968cc2085e4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:41.098161 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd2939-64e8-4c6c-886d-3968cc2085e4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:41.099876 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd2939-64e8-4c6c-886d-3968cc2085e4 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:41.110187 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-3dcd2939-64e8-4c6c-886d-3968cc2085e4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:06:41.110187 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:41.110187 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:06:41.110187 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:06:41.110187 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:06:41.110187 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:06:41.110187 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:06:41.110187 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:06:41.110187 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:06:41.110187 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:41.110187 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:06:41.110187 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:41.110187 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:41.110187 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:41.110187 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:41.110187 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:41.110187 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:41.111212 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:41.111212 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:41.111212 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:41.111212 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:41.111212 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:41.111212 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:41.111212 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:06:41.111212 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:06:41.111212 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:06:41.111212 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:06:41.111212 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:41.111212 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:41.111212 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:41.111212 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:41.111212 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:41.111212 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:41.112068 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:41.112068 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:41.112068 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:41.112068 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:41.112068 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:41.112068 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:41.112068 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:41.112068 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:41.112068 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:41.112068 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:41.112068 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:06:41.112068 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:06:41.112068 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:06:41.112068 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:41.112068 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 325/664] 10.222.0.20 () {56 vars in 1129 bytes} [Fri Sep 9 11:06:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:06:41.116947 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd2939-64e8-4c6c-886d-3968cc2085e4 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:41.125318 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884b9e4-417a-4b49-9a95-7cf896d3327f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:41.126234 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884b9e4-417a-4b49-9a95-7cf896d3327f None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:41.126738 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884b9e4-417a-4b49-9a95-7cf896d3327f None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:41.127209 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884b9e4-417a-4b49-9a95-7cf896d3327f None admin] PATH_INFO: `/v3/services` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:41.128042 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884b9e4-417a-4b49-9a95-7cf896d3327f None admin] RBAC: Adding query filter params (name=network) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:41.128558 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884b9e4-417a-4b49-9a95-7cf896d3327f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:41.130193 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884b9e4-417a-4b49-9a95-7cf896d3327f None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:41.135361 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 340/665] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 9 11:06:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:06:41.141824 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884b9e4-417a-4b49-9a95-7cf896d3327f None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:41.201103 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:41.224459 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:41.250435 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884b9e4-417a-4b49-9a95-7cf896d3327f None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:41.259600 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd2939-64e8-4c6c-886d-3968cc2085e4 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:41.286451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91946bc1-2c2b-4db8-b8f9-e8c7c6b3bf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:41.287764 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91946bc1-2c2b-4db8-b8f9-e8c7c6b3bf85 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:41.288251 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91946bc1-2c2b-4db8-b8f9-e8c7c6b3bf85 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:41.288743 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91946bc1-2c2b-4db8-b8f9-e8c7c6b3bf85 None admin] PATH_INFO: `/v3/services` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:41.289601 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91946bc1-2c2b-4db8-b8f9-e8c7c6b3bf85 None admin] RBAC: Adding query filter params (type=network) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:41.290125 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91946bc1-2c2b-4db8-b8f9-e8c7c6b3bf85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:41.291692 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91946bc1-2c2b-4db8-b8f9-e8c7c6b3bf85 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:41.305311 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8655c3e-b0db-49c9-a4ba-8648d81c8158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:41.305311 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8655c3e-b0db-49c9-a4ba-8648d81c8158 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:41.305311 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8655c3e-b0db-49c9-a4ba-8648d81c8158 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:41.305311 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8655c3e-b0db-49c9-a4ba-8648d81c8158 None admin] PATH_INFO: `/v3/services` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:41.305832 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8655c3e-b0db-49c9-a4ba-8648d81c8158 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:41.305832 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8655c3e-b0db-49c9-a4ba-8648d81c8158 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:41.306541 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 341/666] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 9 11:06:41 2022] GET /identity/v3/services?type=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:06:41.306980 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8655c3e-b0db-49c9-a4ba-8648d81c8158 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:41.318530 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 326/667] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Sep 9 11:06:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:06:41.325554 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91946bc1-2c2b-4db8-b8f9-e8c7c6b3bf85 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:41.447195 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91946bc1-2c2b-4db8-b8f9-e8c7c6b3bf85 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:41.469819 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:41.491028 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fa200-91ab-4c0a-9428-3ba081d32e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:41.492054 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fa200-91ab-4c0a-9428-3ba081d32e26 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:41.492541 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fa200-91ab-4c0a-9428-3ba081d32e26 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:41.493021 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fa200-91ab-4c0a-9428-3ba081d32e26 None admin] PATH_INFO: `/v3/services` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:41.493932 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86fa200-91ab-4c0a-9428-3ba081d32e26 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:41.494462 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86fa200-91ab-4c0a-9428-3ba081d32e26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:41.496058 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86fa200-91ab-4c0a-9428-3ba081d32e26 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:41.502586 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 342/668] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Sep 9 11:06:41 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:42.260481 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11026fc7-0459-4940-a72e-781b430b0ee0 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:42.261348 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11026fc7-0459-4940-a72e-781b430b0ee0 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:42.261348 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11026fc7-0459-4940-a72e-781b430b0ee0 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:42.262619 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 327/669] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:06:42.269040 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9b58c-e3de-4d53-9d7f-c81e4a2298db None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:42.269980 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9b58c-e3de-4d53-9d7f-c81e4a2298db None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:42.270700 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9b58c-e3de-4d53-9d7f-c81e4a2298db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:42.303293 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-fec9b58c-e3de-4d53-9d7f-c81e4a2298db None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:42.306655 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-fec9b58c-e3de-4d53-9d7f-c81e4a2298db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:42.429704 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 343/670] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:06:42.751399 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11026fc7-0459-4940-a72e-781b430b0ee0 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:42.869334 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11026fc7-0459-4940-a72e-781b430b0ee0 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:42.906185 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58579d85-0979-4956-8fc8-30a87fcb4ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:42.906820 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58579d85-0979-4956-8fc8-30a87fcb4ca9 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:42.907092 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58579d85-0979-4956-8fc8-30a87fcb4ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:42.907358 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58579d85-0979-4956-8fc8-30a87fcb4ca9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:42.920087 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58579d85-0979-4956-8fc8-30a87fcb4ca9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:06:42.924823 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-58579d85-0979-4956-8fc8-30a87fcb4ca9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:06:42.924823 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:42.924823 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:42.924823 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:42.924823 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:42.924823 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:42.924823 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:42.924823 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:42.924823 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:42.924823 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:42.924823 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:42.924823 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:42.924823 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:06:42.924823 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:06:42.924823 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:06:42.924823 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:06:42.926604 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:06:42.926604 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:06:42.926604 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:06:42.926604 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:06:42.926604 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:42.926604 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:42.926604 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:42.926604 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:42.926604 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:42.926604 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:42.926604 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:42.926604 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:42.926604 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:42.926604 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:42.926604 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:42.926604 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:42.928315 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:42.928315 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:42.928315 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:42.928315 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:42.928315 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:06:42.928315 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:06:42.928315 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:06:42.928315 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:06:42.928315 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:06:42.928315 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:06:42.928315 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:06:42.928315 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:42.928315 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 328/671] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 9 11:06:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:42.933343 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9b58c-e3de-4d53-9d7f-c81e4a2298db None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:43.071583 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9b58c-e3de-4d53-9d7f-c81e4a2298db None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:43.101659 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:43.134919 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24052a00-706b-4a91-870c-8b7986aa59cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:43.136081 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24052a00-706b-4a91-870c-8b7986aa59cb None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:43.136587 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24052a00-706b-4a91-870c-8b7986aa59cb None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:43.137616 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24052a00-706b-4a91-870c-8b7986aa59cb None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:43.138810 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24052a00-706b-4a91-870c-8b7986aa59cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:43.139363 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24052a00-706b-4a91-870c-8b7986aa59cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:43.142232 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24052a00-706b-4a91-870c-8b7986aa59cb None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:43.157942 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 344/672] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:06:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:43.163307 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58579d85-0979-4956-8fc8-30a87fcb4ca9 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:43.173021 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:43.269800 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d6687-1440-43b4-8777-3d7bb34bdb6e None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:43.270113 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d6687-1440-43b4-8777-3d7bb34bdb6e None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:43.270512 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d6687-1440-43b4-8777-3d7bb34bdb6e None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:43.273543 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 345/673] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:43.279894 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4aa14-b209-4840-88a0-5ce0b4536278 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:43.280200 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4aa14-b209-4840-88a0-5ce0b4536278 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:43.280453 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4aa14-b209-4840-88a0-5ce0b4536278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:43.288095 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58579d85-0979-4956-8fc8-30a87fcb4ca9 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:43.304600 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-c1a4aa14-b209-4840-88a0-5ce0b4536278 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:43.306079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-c1a4aa14-b209-4840-88a0-5ce0b4536278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:43.342052 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b5cb3-265c-4c79-99ea-c09bf21c916a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:43.342909 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b5cb3-265c-4c79-99ea-c09bf21c916a None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:43.343412 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b5cb3-265c-4c79-99ea-c09bf21c916a None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:43.343830 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b5cb3-265c-4c79-99ea-c09bf21c916a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:43.357916 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b5cb3-265c-4c79-99ea-c09bf21c916a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:43.359985 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b5cb3-265c-4c79-99ea-c09bf21c916a None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:43.379339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-e58b5cb3-265c-4c79-99ea-c09bf21c916a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:43.379339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:43.379339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:43.379339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:43.379339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:43.379339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:43.379339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:43.379339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:43.379339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:43.379339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:43.379339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:43.379339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:43.379339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:43.379339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:43.379339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:43.379339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:43.380362 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:43.380362 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:43.380362 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:43.380362 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:43.380362 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:43.380362 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:43.380362 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:43.380362 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:43.380362 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:43.380362 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:43.380362 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:43.380362 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:43.380362 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:43.380362 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:43.380362 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:43.380362 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:43.380362 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:43.381237 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:43.381237 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:43.381237 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:43.385363 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 329/674] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:43.387669 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b5cb3-265c-4c79-99ea-c09bf21c916a None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:43.400581 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 346/675] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:06:43.452753 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:43.499987 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b5cb3-265c-4c79-99ea-c09bf21c916a None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:43.536524 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ee6b4-12ab-42d6-99a9-0673d3d1a2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:43.537141 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ee6b4-12ab-42d6-99a9-0673d3d1a2f9 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:43.537460 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ee6b4-12ab-42d6-99a9-0673d3d1a2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:43.537734 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ee6b4-12ab-42d6-99a9-0673d3d1a2f9 None admin] PATH_INFO: `/v3/domains` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:43.538401 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ee6b4-12ab-42d6-99a9-0673d3d1a2f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:43.538701 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ee6b4-12ab-42d6-99a9-0673d3d1a2f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:43.540159 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ee6b4-12ab-42d6-99a9-0673d3d1a2f9 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:43.555921 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 330/676] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:43.562604 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4aa14-b209-4840-88a0-5ce0b4536278 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:43.676946 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4aa14-b209-4840-88a0-5ce0b4536278 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:43.679820 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:43.718923 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8539dd-fc30-4c64-8a79-03f658afd9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:43.719917 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8539dd-fc30-4c64-8a79-03f658afd9fc None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:43.720404 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8539dd-fc30-4c64-8a79-03f658afd9fc None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:43.720881 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8539dd-fc30-4c64-8a79-03f658afd9fc None admin] PATH_INFO: `/v3/users/nova` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:43.728537 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8539dd-fc30-4c64-8a79-03f658afd9fc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:43.730323 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8539dd-fc30-4c64-8a79-03f658afd9fc None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:43.743162 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-2c8539dd-fc30-4c64-8a79-03f658afd9fc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:06:43.743162 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:43.743162 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:43.743162 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:43.743162 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:43.743162 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:43.743162 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:43.743162 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:43.743162 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:43.743162 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:43.743162 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:43.743162 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:43.743162 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:06:43.743162 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:06:43.743162 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:06:43.743162 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:06:43.744153 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:43.744153 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:43.744153 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:06:43.744153 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:06:43.744153 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:06:43.744153 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:06:43.744153 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:43.744153 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:43.744153 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:43.744153 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:43.744153 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:43.744153 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:43.744153 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:43.744153 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:43.744153 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:43.744153 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:43.744153 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:43.744153 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:43.745118 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:43.745118 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:43.745118 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:06:43.745118 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:06:43.745118 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:06:43.745118 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:06:43.745118 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:06:43.745118 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:06:43.745118 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:06:43.745118 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:43.751629 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 347/677] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 9 11:06:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:43.758379 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ee6b4-12ab-42d6-99a9-0673d3d1a2f9 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:43.773492 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8539dd-fc30-4c64-8a79-03f658afd9fc None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:43.873733 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ee6b4-12ab-42d6-99a9-0673d3d1a2f9 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:43.891661 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:43.910554 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e384dc-9e41-4e4f-a761-fb8efe5d1fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:43.911403 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e384dc-9e41-4e4f-a761-fb8efe5d1fda None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:43.911403 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e384dc-9e41-4e4f-a761-fb8efe5d1fda None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:43.911723 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e384dc-9e41-4e4f-a761-fb8efe5d1fda None admin] PATH_INFO: `/v3/users` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:43.912392 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e384dc-9e41-4e4f-a761-fb8efe5d1fda None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:43.912851 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e384dc-9e41-4e4f-a761-fb8efe5d1fda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:43.914228 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e384dc-9e41-4e4f-a761-fb8efe5d1fda None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:43.915462 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8539dd-fc30-4c64-8a79-03f658afd9fc None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:43.938848 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 331/678] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 9 11:06:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:43.941376 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e384dc-9e41-4e4f-a761-fb8efe5d1fda None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:43.962380 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8aa116-428c-4c5f-8410-6ec8cc77a26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:43.963084 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8aa116-428c-4c5f-8410-6ec8cc77a26e None admin] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:43.963366 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8aa116-428c-4c5f-8410-6ec8cc77a26e None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:43.963636 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8aa116-428c-4c5f-8410-6ec8cc77a26e None admin] PATH_INFO: `/v3/services` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:43.964709 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8aa116-428c-4c5f-8410-6ec8cc77a26e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:43.966474 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8aa116-428c-4c5f-8410-6ec8cc77a26e None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:43.988642 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 348/679] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 9 11:06:43 2022] POST /identity/v3/services => generated 242 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:06:43.990350 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac1f60-6f39-4f6e-a4c7-a1ec5a77fa5f None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:43.990350 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac1f60-6f39-4f6e-a4c7-a1ec5a77fa5f None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:43.990653 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac1f60-6f39-4f6e-a4c7-a1ec5a77fa5f None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:43.992059 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 349/680] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:44.003049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc6043-97c2-443e-85ca-71754593f482 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:44.003389 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc6043-97c2-443e-85ca-71754593f482 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:44.003608 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc6043-97c2-443e-85ca-71754593f482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:44.032768 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-2edc6043-97c2-443e-85ca-71754593f482 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:44.034055 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-2edc6043-97c2-443e-85ca-71754593f482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:44.058671 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:44.077238 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e384dc-9e41-4e4f-a761-fb8efe5d1fda None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:44.124414 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76aaec4-2b20-4dcf-90ca-678d99bb7fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:44.125509 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76aaec4-2b20-4dcf-90ca-678d99bb7fc8 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:44.126052 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76aaec4-2b20-4dcf-90ca-678d99bb7fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:44.126532 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76aaec4-2b20-4dcf-90ca-678d99bb7fc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:44.137866 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 350/681] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:44 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:06:44.139824 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76aaec4-2b20-4dcf-90ca-678d99bb7fc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:44.141805 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76aaec4-2b20-4dcf-90ca-678d99bb7fc8 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:44.160345 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-a76aaec4-2b20-4dcf-90ca-678d99bb7fc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:44.160345 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:44.160345 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:44.160345 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:44.160345 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:44.160345 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:44.160345 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:44.160345 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:44.160345 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:44.160345 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:44.160345 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:44.160345 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:44.160345 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:44.160345 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:44.160345 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:44.160345 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:44.161411 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:44.161411 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:44.161411 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:44.161411 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:44.161411 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:44.161411 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:44.161411 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:44.161411 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:44.161411 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:44.161411 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:44.161411 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:44.161411 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:44.161411 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:44.161411 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:44.161411 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:44.161411 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:44.161411 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:44.162320 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:44.162320 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:44.162320 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:44.169019 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 332/682] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:06:44.171189 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc6043-97c2-443e-85ca-71754593f482 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:44.272143 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10979498-e229-477f-a84a-8259069c1925 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:44.272462 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10979498-e229-477f-a84a-8259069c1925 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:44.272687 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10979498-e229-477f-a84a-8259069c1925 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:44.274280 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 333/683] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:44.279296 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbaaa38-8fbf-4c6f-933a-426de5af26a7 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:44.279577 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbaaa38-8fbf-4c6f-933a-426de5af26a7 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:44.279848 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbaaa38-8fbf-4c6f-933a-426de5af26a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:44.282422 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc6043-97c2-443e-85ca-71754593f482 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:44.301077 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-acbaaa38-8fbf-4c6f-933a-426de5af26a7 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:44.302398 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-acbaaa38-8fbf-4c6f-933a-426de5af26a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:44.321155 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:44.324261 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbb12a-0ceb-405e-b427-2fbcd1a1f853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:44.325543 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbb12a-0ceb-405e-b427-2fbcd1a1f853 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:44.325830 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbb12a-0ceb-405e-b427-2fbcd1a1f853 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:44.326103 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbb12a-0ceb-405e-b427-2fbcd1a1f853 None admin] PATH_INFO: `/v3/domains` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:44.328030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dbb12a-0ceb-405e-b427-2fbcd1a1f853 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:44.328337 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dbb12a-0ceb-405e-b427-2fbcd1a1f853 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:44.330056 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dbb12a-0ceb-405e-b427-2fbcd1a1f853 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:44.345137 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 351/684] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:44.350816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbb12a-0ceb-405e-b427-2fbcd1a1f853 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:44.374394 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:44.380916 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 334/685] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:44 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:06:44.482993 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbb12a-0ceb-405e-b427-2fbcd1a1f853 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:44.518314 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84db8c-e5fa-49e8-ad0d-79cf0b14564e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:44.519354 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84db8c-e5fa-49e8-ad0d-79cf0b14564e None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:44.519635 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84db8c-e5fa-49e8-ad0d-79cf0b14564e None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:44.519902 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbaaa38-8fbf-4c6f-933a-426de5af26a7 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:44.520007 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84db8c-e5fa-49e8-ad0d-79cf0b14564e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:44.528158 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84db8c-e5fa-49e8-ad0d-79cf0b14564e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:44.529666 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84db8c-e5fa-49e8-ad0d-79cf0b14564e None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:44.542356 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-1b84db8c-e5fa-49e8-ad0d-79cf0b14564e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:06:44.542356 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:44.542356 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:44.542356 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:44.542356 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:44.542356 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:44.542356 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:44.542356 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:44.542356 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:44.542356 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:44.542356 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:44.542356 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:44.542356 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:06:44.542356 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:06:44.542356 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:06:44.543920 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:06:44.543920 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:44.543920 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:44.543920 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:44.543920 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:44.543920 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:44.543920 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:44.543920 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:44.543920 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:44.543920 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:44.543920 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:44.543920 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:44.543920 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:44.543920 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:44.543920 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:44.543920 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:44.543920 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:44.545092 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:06:44.545092 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:06:44.545092 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:06:44.545092 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:06:44.545092 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:06:44.545092 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:06:44.545092 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:06:44.545092 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:44.548969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 352/686] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:06:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:44.550214 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84db8c-e5fa-49e8-ad0d-79cf0b14564e None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:44.645470 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbaaa38-8fbf-4c6f-933a-426de5af26a7 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:44.652500 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:44.685534 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076cba8-5d02-4813-b6ff-11d29c2d7df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:44.686430 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84db8c-e5fa-49e8-ad0d-79cf0b14564e None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:44.686756 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076cba8-5d02-4813-b6ff-11d29c2d7df4 None admin] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:44.687268 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076cba8-5d02-4813-b6ff-11d29c2d7df4 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:44.687846 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076cba8-5d02-4813-b6ff-11d29c2d7df4 None admin] PATH_INFO: `/v3/services` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:44.688801 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a076cba8-5d02-4813-b6ff-11d29c2d7df4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:44.690415 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a076cba8-5d02-4813-b6ff-11d29c2d7df4 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:44.717944 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 335/687] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 9 11:06:44 2022] POST /identity/v3/services => generated 251 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:06:44.742012 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076cba8-5d02-4813-b6ff-11d29c2d7df4 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:44.752692 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1581452-d8cb-422c-9191-723b94c4f9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:44.753383 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1581452-d8cb-422c-9191-723b94c4f9be None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:44.753664 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1581452-d8cb-422c-9191-723b94c4f9be None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:44.753929 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1581452-d8cb-422c-9191-723b94c4f9be None admin] PATH_INFO: `/v3/projects` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:44.754767 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1581452-d8cb-422c-9191-723b94c4f9be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:44.755089 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1581452-d8cb-422c-9191-723b94c4f9be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:44.756843 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1581452-d8cb-422c-9191-723b94c4f9be None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:44.760197 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:44.775108 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 353/688] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 9 11:06:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:06:44.782418 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1581452-d8cb-422c-9191-723b94c4f9be None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:44.870502 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076cba8-5d02-4813-b6ff-11d29c2d7df4 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:44.905670 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1581452-d8cb-422c-9191-723b94c4f9be None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:44.910088 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2b69a-da19-4a03-a6f2-20d876268860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:44.910800 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2b69a-da19-4a03-a6f2-20d876268860 None admin] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:44.911138 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2b69a-da19-4a03-a6f2-20d876268860 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:44.911474 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2b69a-da19-4a03-a6f2-20d876268860 None admin] PATH_INFO: `/v3/services` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:44.912233 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2b69a-da19-4a03-a6f2-20d876268860 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:44.913869 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2b69a-da19-4a03-a6f2-20d876268860 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:44.933469 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 336/689] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 9 11:06:44 2022] POST /identity/v3/services => generated 240 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:06:44.950970 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:44.966904 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798e0e7-79b6-46db-afbd-b783b0a37f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:44.967612 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798e0e7-79b6-46db-afbd-b783b0a37f82 None admin] REQUEST_METHOD: `PUT` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:44.967894 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798e0e7-79b6-46db-afbd-b783b0a37f82 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:44.968163 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798e0e7-79b6-46db-afbd-b783b0a37f82 None admin] PATH_INFO: `/v3/projects/b9cec15abcd74e13ba458c64ad6fdf9b/users/417acfbae1244469961371115a42498e/roles/b02ba8c157bf46f4a75cdab917db78db` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:44.970349 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f798e0e7-79b6-46db-afbd-b783b0a37f82 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9cec15abcd74e13ba458c64ad6fdf9b, user_id=417acfbae1244469961371115a42498e, role_id=b02ba8c157bf46f4a75cdab917db78db)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:44.971885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f798e0e7-79b6-46db-afbd-b783b0a37f82 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:44.989958 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 354/690] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 9 11:06:44 2022] PUT /identity/v3/projects/b9cec15abcd74e13ba458c64ad6fdf9b/users/417acfbae1244469961371115a42498e/roles/b02ba8c157bf46f4a75cdab917db78db => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:06:46.521318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4cd4e-37ed-4833-95d6-1ee1ab99ad09 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:46.521922 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4cd4e-37ed-4833-95d6-1ee1ab99ad09 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:46.521922 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4cd4e-37ed-4833-95d6-1ee1ab99ad09 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:46.523316 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 337/691] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:46.529403 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1119723-b186-4c23-b764-204b2ecd34a4 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:46.530277 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1119723-b186-4c23-b764-204b2ecd34a4 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:46.530769 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1119723-b186-4c23-b764-204b2ecd34a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:46.550192 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-f1119723-b186-4c23-b764-204b2ecd34a4 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:46.551662 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-f1119723-b186-4c23-b764-204b2ecd34a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:46.621939 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 355/692] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:46 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:06:46.951457 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4cd4e-37ed-4833-95d6-1ee1ab99ad09 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:47.031767 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:47.065907 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4cd4e-37ed-4833-95d6-1ee1ab99ad09 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:47.110201 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ef362-6f80-4f43-b212-1bb35e85ad3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:47.110840 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ef362-6f80-4f43-b212-1bb35e85ad3b None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:47.111121 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ef362-6f80-4f43-b212-1bb35e85ad3b None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:47.111402 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ef362-6f80-4f43-b212-1bb35e85ad3b None admin] PATH_INFO: `/v3/services/image` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:47.111984 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ef362-6f80-4f43-b212-1bb35e85ad3b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:47.113379 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ef362-6f80-4f43-b212-1bb35e85ad3b None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:47.123381 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-758ef362-6f80-4f43-b212-1bb35e85ad3b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 11:06:47.123381 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:47.123381 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:06:47.123381 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:06:47.123381 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:06:47.123381 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:06:47.123381 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:06:47.123381 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:06:47.123381 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 11:06:47.123381 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:47.123381 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:06:47.123381 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:47.123381 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:47.123381 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:47.123381 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:47.123381 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:47.123381 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:47.124427 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:47.124427 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:47.124427 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:47.124427 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:47.124427 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:47.124427 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:47.124427 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:06:47.124427 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:06:47.124427 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:06:47.124427 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:06:47.124427 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:47.124427 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:47.124427 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:47.124427 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:47.124427 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:47.124427 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:47.125774 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:47.125774 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:47.125774 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:47.125774 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:47.125774 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:47.125774 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:47.125774 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:47.125774 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:47.125774 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:47.125774 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:47.125774 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:06:47.125774 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:06:47.125774 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 11:06:47.125774 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:47.125774 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 338/693] 10.222.0.20 () {56 vars in 1105 bytes} [Fri Sep 9 11:06:46 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:47.130420 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1119723-b186-4c23-b764-204b2ecd34a4 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:47.235930 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1119723-b186-4c23-b764-204b2ecd34a4 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:47.254389 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:47.274798 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40c6ab-8dc4-45f4-a5ca-014dcb9beee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:47.275410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40c6ab-8dc4-45f4-a5ca-014dcb9beee2 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:47.275690 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40c6ab-8dc4-45f4-a5ca-014dcb9beee2 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:47.276025 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40c6ab-8dc4-45f4-a5ca-014dcb9beee2 None admin] PATH_INFO: `/v3/services` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:47.276670 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40c6ab-8dc4-45f4-a5ca-014dcb9beee2 None admin] RBAC: Adding query filter params (name=image) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:47.276972 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40c6ab-8dc4-45f4-a5ca-014dcb9beee2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:47.278928 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40c6ab-8dc4-45f4-a5ca-014dcb9beee2 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:47.284081 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 356/694] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:47.289684 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ef362-6f80-4f43-b212-1bb35e85ad3b None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:47.370112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73693911-e52c-4418-afee-f6949bda4897 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:47.370465 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73693911-e52c-4418-afee-f6949bda4897 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:47.370702 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73693911-e52c-4418-afee-f6949bda4897 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:47.372737 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 357/695] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:47.378102 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7cbd7-bb6c-471b-97e9-4580ffa7cf17 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:47.378681 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7cbd7-bb6c-471b-97e9-4580ffa7cf17 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:47.379255 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7cbd7-bb6c-471b-97e9-4580ffa7cf17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:47.398580 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-0db7cbd7-bb6c-471b-97e9-4580ffa7cf17 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:47.400125 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-0db7cbd7-bb6c-471b-97e9-4580ffa7cf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:47.414448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ef362-6f80-4f43-b212-1bb35e85ad3b None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:47.453300 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e5136-c3f3-4d52-9462-2fdb3ea97373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:47.453977 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e5136-c3f3-4d52-9462-2fdb3ea97373 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:47.454264 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e5136-c3f3-4d52-9462-2fdb3ea97373 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:47.454536 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e5136-c3f3-4d52-9462-2fdb3ea97373 None admin] PATH_INFO: `/v3/services` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:47.455170 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e5136-c3f3-4d52-9462-2fdb3ea97373 None admin] RBAC: Adding query filter params (type=image) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:47.455645 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e5136-c3f3-4d52-9462-2fdb3ea97373 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:47.457385 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e5136-c3f3-4d52-9462-2fdb3ea97373 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:47.459856 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:47.463619 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 339/696] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:47.469493 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e5136-c3f3-4d52-9462-2fdb3ea97373 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:47.492072 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 358/697] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:47 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:06:47.498718 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d03fff-2047-4a2e-9e86-fcc402cdd136 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:47.499319 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d03fff-2047-4a2e-9e86-fcc402cdd136 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:47.499792 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d03fff-2047-4a2e-9e86-fcc402cdd136 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:47.501707 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 359/698] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:06:47.509060 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8661ae-11d0-435d-b2d5-c83b15eda5c1 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:47.509585 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8661ae-11d0-435d-b2d5-c83b15eda5c1 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:47.510098 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8661ae-11d0-435d-b2d5-c83b15eda5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:47.528791 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-6c8661ae-11d0-435d-b2d5-c83b15eda5c1 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:47.530324 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-6c8661ae-11d0-435d-b2d5-c83b15eda5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:47.592623 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e5136-c3f3-4d52-9462-2fdb3ea97373 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:47.603331 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 360/699] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:47 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:06:47.605568 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ccff9-0d8d-4489-8031-92e096588b4e None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:47.606033 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ccff9-0d8d-4489-8031-92e096588b4e None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:47.606532 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ccff9-0d8d-4489-8031-92e096588b4e None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:47.608380 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 361/700] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:47.613646 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f868ff-eaaf-452e-a436-3c20a728fd08 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:47.614157 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f868ff-eaaf-452e-a436-3c20a728fd08 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:47.614766 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f868ff-eaaf-452e-a436-3c20a728fd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:47.633270 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff89331-a4b6-42b5-9ab3-9b887848e6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:47.633908 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff89331-a4b6-42b5-9ab3-9b887848e6f8 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:47.634229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff89331-a4b6-42b5-9ab3-9b887848e6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:47.634700 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff89331-a4b6-42b5-9ab3-9b887848e6f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:47.635598 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff89331-a4b6-42b5-9ab3-9b887848e6f8 None admin] RBAC: Adding query filter params (interface=public, service_id=8def0416b3fe46d49c4e378496564f4a, region_id=RegionOne) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:47.636058 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff89331-a4b6-42b5-9ab3-9b887848e6f8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:47.637917 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-e0f868ff-eaaf-452e-a436-3c20a728fd08 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:47.638321 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff89331-a4b6-42b5-9ab3-9b887848e6f8 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:47.639245 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-e0f868ff-eaaf-452e-a436-3c20a728fd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:47.647168 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 340/701] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Sep 9 11:06:47 2022] GET /identity/v3/endpoints?service_id=8def0416b3fe46d49c4e378496564f4a&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:06:47.654371 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff89331-a4b6-42b5-9ab3-9b887848e6f8 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:47.685848 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:47.725378 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 362/702] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:47 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:06:47.726304 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:47.770517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff89331-a4b6-42b5-9ab3-9b887848e6f8 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:47.808176 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c87a86-03ad-48e2-a60e-c856e8690595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:47.809367 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c87a86-03ad-48e2-a60e-c856e8690595 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:47.809647 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c87a86-03ad-48e2-a60e-c856e8690595 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:47.809965 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c87a86-03ad-48e2-a60e-c856e8690595 None admin] PATH_INFO: `/v3/services` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:47.810568 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c87a86-03ad-48e2-a60e-c856e8690595 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:47.811916 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c87a86-03ad-48e2-a60e-c856e8690595 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:47.817933 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 341/703] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 9 11:06:47 2022] GET /identity/v3/services => generated 1002 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:06:47.822670 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f868ff-eaaf-452e-a436-3c20a728fd08 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:47.932933 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f868ff-eaaf-452e-a436-3c20a728fd08 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:47.970937 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2238c-9672-4a15-9eb9-c6af07545e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:47.971587 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2238c-9672-4a15-9eb9-c6af07545e7e None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:47.971865 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2238c-9672-4a15-9eb9-c6af07545e7e None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:47.972141 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2238c-9672-4a15-9eb9-c6af07545e7e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:47.972735 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2238c-9672-4a15-9eb9-c6af07545e7e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:47.974204 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2238c-9672-4a15-9eb9-c6af07545e7e None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:47.983816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-62c2238c-9672-4a15-9eb9-c6af07545e7e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:06:47.983816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:47.983816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:06:47.983816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:06:47.983816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:06:47.983816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:06:47.983816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:06:47.983816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:06:47.983816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:06:47.983816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:47.983816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:06:47.983816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:47.983816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:47.983816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:47.983816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:47.983816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:47.983816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:47.984888 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:47.984888 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:47.984888 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:47.984888 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:47.984888 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:47.984888 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:47.984888 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:06:47.984888 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:06:47.984888 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:06:47.984888 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:06:47.984888 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:47.984888 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:47.984888 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:47.984888 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:47.984888 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:47.984888 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:47.985752 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:47.985752 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:47.985752 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:47.985752 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:47.985752 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:47.985752 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:47.985752 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:47.985752 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:47.985752 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:47.985752 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:47.985752 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:06:47.985752 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:06:47.985752 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:06:47.985752 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:47.988864 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 363/704] 10.222.0.20 () {56 vars in 1129 bytes} [Fri Sep 9 11:06:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:47.991337 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c87a86-03ad-48e2-a60e-c856e8690595 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:47.991482 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2238c-9672-4a15-9eb9-c6af07545e7e None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:48.035628 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:48.111746 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2238c-9672-4a15-9eb9-c6af07545e7e None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:48.126619 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c87a86-03ad-48e2-a60e-c856e8690595 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:48.150555 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206aaa21-7aa7-4616-8fea-94e1e778ee99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:48.151895 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206aaa21-7aa7-4616-8fea-94e1e778ee99 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:48.152369 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206aaa21-7aa7-4616-8fea-94e1e778ee99 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:48.153055 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206aaa21-7aa7-4616-8fea-94e1e778ee99 None admin] PATH_INFO: `/v3/services` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:48.153784 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206aaa21-7aa7-4616-8fea-94e1e778ee99 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:48.154094 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206aaa21-7aa7-4616-8fea-94e1e778ee99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:48.155458 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206aaa21-7aa7-4616-8fea-94e1e778ee99 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:48.158166 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:48.166224 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 364/705] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Sep 9 11:06:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:06:48.166496 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cedd84c-30aa-4383-a708-dd1194446de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:48.167109 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedd84c-30aa-4383-a708-dd1194446de6 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:48.167209 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206aaa21-7aa7-4616-8fea-94e1e778ee99 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:48.167388 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedd84c-30aa-4383-a708-dd1194446de6 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:48.167723 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedd84c-30aa-4383-a708-dd1194446de6 None admin] PATH_INFO: `/v3/services/network` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:48.168388 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cedd84c-30aa-4383-a708-dd1194446de6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:48.170057 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cedd84c-30aa-4383-a708-dd1194446de6 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:48.179111 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-0cedd84c-30aa-4383-a708-dd1194446de6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:06:48.179111 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:48.179111 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:06:48.179111 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:06:48.179111 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:06:48.179111 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:06:48.179111 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:06:48.179111 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:06:48.179111 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:06:48.179111 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:48.179111 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:06:48.179111 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:48.179111 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:48.179111 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:48.179111 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:48.179111 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:48.179111 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:48.180343 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:48.180343 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:48.180343 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:48.180343 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:48.180343 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:48.180343 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:48.180343 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:06:48.180343 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:06:48.180343 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:06:48.180343 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:06:48.180343 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:48.180343 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:48.180343 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:48.180343 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:48.180343 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:48.180343 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:48.181335 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:48.181335 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:48.181335 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:48.181335 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:48.181335 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:48.181335 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:48.181335 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:48.181335 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:48.181335 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:48.181335 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:48.181335 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:06:48.181335 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:06:48.181335 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:06:48.181335 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:48.181335 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 342/706] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:06:47 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:48.182148 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cedd84c-30aa-4383-a708-dd1194446de6 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:48.279142 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:48.283639 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206aaa21-7aa7-4616-8fea-94e1e778ee99 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:48.292030 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cedd84c-30aa-4383-a708-dd1194446de6 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:48.320067 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a975ab-64e1-48ae-9cbf-f02f05c9e92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:48.320705 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a975ab-64e1-48ae-9cbf-f02f05c9e92c None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:48.320981 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a975ab-64e1-48ae-9cbf-f02f05c9e92c None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:48.321253 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a975ab-64e1-48ae-9cbf-f02f05c9e92c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:48.332930 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a975ab-64e1-48ae-9cbf-f02f05c9e92c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:06:48.336636 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c2469-e3c1-4af4-8844-ec287f9e952a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:48.337269 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c2469-e3c1-4af4-8844-ec287f9e952a None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:48.337575 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c2469-e3c1-4af4-8844-ec287f9e952a None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:48.337850 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c2469-e3c1-4af4-8844-ec287f9e952a None admin] PATH_INFO: `/v3/services` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:48.338468 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-c5a975ab-64e1-48ae-9cbf-f02f05c9e92c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:06:48.338468 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:48.338468 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:48.338468 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:48.338468 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:48.338468 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:48.338468 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:48.338468 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:48.338468 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:48.338468 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:48.338468 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:48.338468 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:48.338468 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:06:48.338468 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:06:48.338468 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:06:48.338468 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:06:48.339391 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:06:48.339391 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:06:48.339391 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:06:48.339391 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:06:48.339391 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:48.339391 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:48.339391 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:48.339391 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:48.339391 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:48.339391 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:48.339391 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:48.339391 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:48.339391 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:48.339391 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:48.339391 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:48.339391 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:48.340240 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:48.340240 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:48.340240 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:48.340240 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:48.340240 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:06:48.340240 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:06:48.340240 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:06:48.340240 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:06:48.340240 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:06:48.340240 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:06:48.340240 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:06:48.340240 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:48.340876 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c2469-e3c1-4af4-8844-ec287f9e952a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:48.340876 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c2469-e3c1-4af4-8844-ec287f9e952a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:48.341003 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 365/707] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 9 11:06:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:48.341003 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a975ab-64e1-48ae-9cbf-f02f05c9e92c None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:48.345815 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c2469-e3c1-4af4-8844-ec287f9e952a None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:48.351473 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 343/708] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Sep 9 11:06:48 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:48.352222 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c2469-e3c1-4af4-8844-ec287f9e952a None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:48.414418 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:48.457301 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a975ab-64e1-48ae-9cbf-f02f05c9e92c None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:48.462014 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c2469-e3c1-4af4-8844-ec287f9e952a None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:48.496930 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8187e-9739-496a-85e0-bb852438866c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:48.497562 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8187e-9739-496a-85e0-bb852438866c None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:48.497840 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8187e-9739-496a-85e0-bb852438866c None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:48.498107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8187e-9739-496a-85e0-bb852438866c None admin] PATH_INFO: `/v3/services` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:48.498736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8187e-9739-496a-85e0-bb852438866c None admin] RBAC: Adding query filter params (name=network) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:48.499031 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8187e-9739-496a-85e0-bb852438866c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:48.500382 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8187e-9739-496a-85e0-bb852438866c None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:48.501717 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0df7e-cdb0-4965-a80c-b5bf907a1554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:48.502583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0df7e-cdb0-4965-a80c-b5bf907a1554 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:48.503067 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0df7e-cdb0-4965-a80c-b5bf907a1554 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:48.503538 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0df7e-cdb0-4965-a80c-b5bf907a1554 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:48.504390 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0df7e-cdb0-4965-a80c-b5bf907a1554 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:48.504905 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0df7e-cdb0-4965-a80c-b5bf907a1554 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:48.505012 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 366/709] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 9 11:06:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:48.505769 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8187e-9739-496a-85e0-bb852438866c None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:48.506961 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0df7e-cdb0-4965-a80c-b5bf907a1554 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:48.521759 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 344/710] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:06:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:48.522723 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0df7e-cdb0-4965-a80c-b5bf907a1554 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:48.532143 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:48.618399 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8187e-9739-496a-85e0-bb852438866c None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:48.634296 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0df7e-cdb0-4965-a80c-b5bf907a1554 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:48.657778 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:48.658100 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f6a27-dfe2-415a-a1bb-442d498d51fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:48.658995 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f6a27-dfe2-415a-a1bb-442d498d51fa None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:48.659295 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f6a27-dfe2-415a-a1bb-442d498d51fa None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:48.659549 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f6a27-dfe2-415a-a1bb-442d498d51fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:48.660234 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f6a27-dfe2-415a-a1bb-442d498d51fa None admin] RBAC: Adding query filter params (interface=public, service_id=f3204865003649b4a7dd716f9ef63139, region_id=RegionOne) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:48.660540 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f6a27-dfe2-415a-a1bb-442d498d51fa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:48.661941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f6a27-dfe2-415a-a1bb-442d498d51fa None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:48.674388 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 367/711] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Sep 9 11:06:48 2022] GET /identity/v3/endpoints?service_id=f3204865003649b4a7dd716f9ef63139&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:48.674388 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f6a27-dfe2-415a-a1bb-442d498d51fa None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:48.686373 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be972a34-0d39-4312-a05a-c33345729efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:48.686984 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be972a34-0d39-4312-a05a-c33345729efd None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:48.687260 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be972a34-0d39-4312-a05a-c33345729efd None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:48.687591 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be972a34-0d39-4312-a05a-c33345729efd None admin] PATH_INFO: `/v3/services` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:48.688144 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be972a34-0d39-4312-a05a-c33345729efd None admin] RBAC: Adding query filter params (type=network) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:48.688652 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be972a34-0d39-4312-a05a-c33345729efd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:48.689843 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be972a34-0d39-4312-a05a-c33345729efd None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:48.694949 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 345/712] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 9 11:06:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:48.695549 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be972a34-0d39-4312-a05a-c33345729efd None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:48.771854 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:48.789650 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f6a27-dfe2-415a-a1bb-442d498d51fa None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:48.797939 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be972a34-0d39-4312-a05a-c33345729efd None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:48.826070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3928999-1d4e-4830-b40e-29ac94330709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:48.826696 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3928999-1d4e-4830-b40e-29ac94330709 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:48.826975 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3928999-1d4e-4830-b40e-29ac94330709 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:48.827245 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3928999-1d4e-4830-b40e-29ac94330709 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:48.833421 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b8706-89e2-4678-a129-04b160babf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:48.834043 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b8706-89e2-4678-a129-04b160babf04 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:48.834721 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b8706-89e2-4678-a129-04b160babf04 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:48.835007 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b8706-89e2-4678-a129-04b160babf04 None admin] PATH_INFO: `/v3/services` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:48.835610 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b8706-89e2-4678-a129-04b160babf04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:48.837401 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b8706-89e2-4678-a129-04b160babf04 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:48.837919 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3928999-1d4e-4830-b40e-29ac94330709 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:48.839570 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3928999-1d4e-4830-b40e-29ac94330709 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:48.843283 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 346/713] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 9 11:06:48 2022] GET /identity/v3/services => generated 1002 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:06:48.843702 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b8706-89e2-4678-a129-04b160babf04 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:48.863343 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-b3928999-1d4e-4830-b40e-29ac94330709 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:48.863343 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:48.863343 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:48.863343 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:48.863343 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:48.863343 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:48.863343 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:48.863343 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:48.863343 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:48.863343 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:48.863343 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:48.863343 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:48.863343 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:48.863343 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:48.863343 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:48.863343 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:48.864371 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:48.864371 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:48.864371 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:48.864371 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:48.864371 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:48.864371 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:48.864371 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:48.864371 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:48.864371 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:48.864371 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:48.864371 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:48.864371 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:48.864371 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:48.864371 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:48.864371 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:48.864371 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:48.864371 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:48.865375 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:48.865375 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:48.865375 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:48.868079 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 368/714] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:48.876104 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3928999-1d4e-4830-b40e-29ac94330709 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:48.969733 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:49.030755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b8706-89e2-4678-a129-04b160babf04 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:49.031775 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3928999-1d4e-4830-b40e-29ac94330709 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:49.072661 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce5755-cfb2-499b-bff4-ee2073e1aa5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:49.074718 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce5755-cfb2-499b-bff4-ee2073e1aa5e None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:49.074718 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce5755-cfb2-499b-bff4-ee2073e1aa5e None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:49.074718 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce5755-cfb2-499b-bff4-ee2073e1aa5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:49.075150 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce5755-cfb2-499b-bff4-ee2073e1aa5e None admin] RBAC: Adding query filter params (interface=public, service_id=e9f53c2fbd0d4d9887f80b1aa61ff996, region_id=RegionOne) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:49.075431 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce5755-cfb2-499b-bff4-ee2073e1aa5e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:49.077037 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce5755-cfb2-499b-bff4-ee2073e1aa5e None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:49.084167 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 347/715] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Sep 9 11:06:48 2022] GET /identity/v3/endpoints?service_id=e9f53c2fbd0d4d9887f80b1aa61ff996&interface=public®ion_id=RegionOne => generated 194 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:49.089134 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57852e5-a49c-48dd-8dc7-1eabe3ba9744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:49.089594 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce5755-cfb2-499b-bff4-ee2073e1aa5e None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:49.090539 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57852e5-a49c-48dd-8dc7-1eabe3ba9744 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:49.091142 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57852e5-a49c-48dd-8dc7-1eabe3ba9744 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:49.091588 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57852e5-a49c-48dd-8dc7-1eabe3ba9744 None admin] PATH_INFO: `/v3/domains` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:49.092942 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57852e5-a49c-48dd-8dc7-1eabe3ba9744 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:49.093382 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57852e5-a49c-48dd-8dc7-1eabe3ba9744 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:49.096102 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57852e5-a49c-48dd-8dc7-1eabe3ba9744 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:49.109178 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:49.113567 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 369/716] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:06:49.119469 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57852e5-a49c-48dd-8dc7-1eabe3ba9744 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:49.218391 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce5755-cfb2-499b-bff4-ee2073e1aa5e None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:49.230188 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:49.260099 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1d58b-419f-4de6-9379-73cb52919e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:49.261112 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1d58b-419f-4de6-9379-73cb52919e3f None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:49.262536 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1d58b-419f-4de6-9379-73cb52919e3f None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:49.263233 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1d58b-419f-4de6-9379-73cb52919e3f None admin] PATH_INFO: `/v3/services` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:49.264533 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1d58b-419f-4de6-9379-73cb52919e3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:49.266634 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1d58b-419f-4de6-9379-73cb52919e3f None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:49.279462 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57852e5-a49c-48dd-8dc7-1eabe3ba9744 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:49.280378 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 348/717] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 9 11:06:49 2022] GET /identity/v3/services => generated 1002 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:06:49.317266 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6238e22-ce89-4afa-9fe0-49b0e4b487cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:49.317969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6238e22-ce89-4afa-9fe0-49b0e4b487cb None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:49.318253 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6238e22-ce89-4afa-9fe0-49b0e4b487cb None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:49.318636 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6238e22-ce89-4afa-9fe0-49b0e4b487cb None admin] PATH_INFO: `/v3/users/nova` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:49.327912 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6238e22-ce89-4afa-9fe0-49b0e4b487cb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:49.329470 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6238e22-ce89-4afa-9fe0-49b0e4b487cb None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:49.343000 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-a6238e22-ce89-4afa-9fe0-49b0e4b487cb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:06:49.343000 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:49.343000 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:49.343000 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:49.343000 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:49.343000 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:49.343000 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:49.343000 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:49.343000 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:49.343000 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:49.343000 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:49.343000 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:49.343000 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:06:49.343000 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:06:49.343000 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:06:49.343000 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:06:49.344049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:49.344049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:49.344049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:06:49.344049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:06:49.344049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:06:49.344049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:06:49.344049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:49.344049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:49.344049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:49.344049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:49.344049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:49.344049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:49.344049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:49.344049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:49.344049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:49.344049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:49.344049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:49.344049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:49.345040 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:49.345040 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:49.345040 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:06:49.345040 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:06:49.345040 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:06:49.345040 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:06:49.345040 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:06:49.345040 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:06:49.345040 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:06:49.345040 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:49.348512 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 370/718] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 9 11:06:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:06:49.350872 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1d58b-419f-4de6-9379-73cb52919e3f None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:49.477309 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1d58b-419f-4de6-9379-73cb52919e3f None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:49.515274 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e978c-ecd8-436d-bd26-0f0e77628bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:49.515894 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e978c-ecd8-436d-bd26-0f0e77628bf9 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:49.516175 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e978c-ecd8-436d-bd26-0f0e77628bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:49.516446 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e978c-ecd8-436d-bd26-0f0e77628bf9 None admin] PATH_INFO: `/v3/users` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:49.517164 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e978c-ecd8-436d-bd26-0f0e77628bf9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:49.517617 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e978c-ecd8-436d-bd26-0f0e77628bf9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:49.520014 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e978c-ecd8-436d-bd26-0f0e77628bf9 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:49.539899 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 349/719] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 9 11:06:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:49.546895 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6238e22-ce89-4afa-9fe0-49b0e4b487cb None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:49.608555 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:49.654221 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6238e22-ce89-4afa-9fe0-49b0e4b487cb None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:49.693877 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937bcb0-2ca9-4ac2-953b-0880a31c7c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:49.694547 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937bcb0-2ca9-4ac2-953b-0880a31c7c9b None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:49.694826 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937bcb0-2ca9-4ac2-953b-0880a31c7c9b None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:49.695100 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937bcb0-2ca9-4ac2-953b-0880a31c7c9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:49.768153 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937bcb0-2ca9-4ac2-953b-0880a31c7c9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:49.769645 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937bcb0-2ca9-4ac2-953b-0880a31c7c9b None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:49.830538 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:49.874627 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 371/720] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:06:49 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:06:49.880131 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e978c-ecd8-436d-bd26-0f0e77628bf9 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:49.914430 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:49.994193 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e978c-ecd8-436d-bd26-0f0e77628bf9 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:50.038897 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda7f35-985f-4da4-8b1a-ac9a316655af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:50.039462 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda7f35-985f-4da4-8b1a-ac9a316655af None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:50.039743 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda7f35-985f-4da4-8b1a-ac9a316655af None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:50.040015 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda7f35-985f-4da4-8b1a-ac9a316655af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:50.052359 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda7f35-985f-4da4-8b1a-ac9a316655af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:50.053952 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda7f35-985f-4da4-8b1a-ac9a316655af None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:50.071033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-9eda7f35-985f-4da4-8b1a-ac9a316655af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:50.071033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:50.071033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:50.071033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:50.071033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:50.071033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:50.071033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:50.071033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:50.071033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:50.071033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:50.071033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:50.071033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:50.071033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:50.071033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:50.071033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:50.071033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:50.072056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:50.072056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:50.072056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:50.072056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:50.072056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:50.072056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:50.072056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:50.072056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:50.072056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:50.072056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:50.072056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:50.072056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:50.072056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:50.072056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:50.072056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:50.072056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:50.072056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:50.072948 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:50.072948 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:50.072948 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:50.072948 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 350/721] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:50.078400 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937bcb0-2ca9-4ac2-953b-0880a31c7c9b None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:50.182466 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937bcb0-2ca9-4ac2-953b-0880a31c7c9b None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:50.229142 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273146c1-cebd-490e-9ffc-25d3127b4924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:50.229796 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273146c1-cebd-490e-9ffc-25d3127b4924 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:50.230073 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273146c1-cebd-490e-9ffc-25d3127b4924 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:50.230443 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273146c1-cebd-490e-9ffc-25d3127b4924 None admin] PATH_INFO: `/v3/domains` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:50.231579 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273146c1-cebd-490e-9ffc-25d3127b4924 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:50.231877 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273146c1-cebd-490e-9ffc-25d3127b4924 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:50.233364 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273146c1-cebd-490e-9ffc-25d3127b4924 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:50.245394 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 372/722] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:50.251003 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda7f35-985f-4da4-8b1a-ac9a316655af None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:50.341880 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:50.363415 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda7f35-985f-4da4-8b1a-ac9a316655af None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:50.399526 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1dbfdf-baac-4db3-9df8-b5671a94bd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:50.400595 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1dbfdf-baac-4db3-9df8-b5671a94bd47 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:50.401092 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1dbfdf-baac-4db3-9df8-b5671a94bd47 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:50.401586 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1dbfdf-baac-4db3-9df8-b5671a94bd47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:50.409243 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1dbfdf-baac-4db3-9df8-b5671a94bd47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:50.410974 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1dbfdf-baac-4db3-9df8-b5671a94bd47 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:50.423271 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-eb1dbfdf-baac-4db3-9df8-b5671a94bd47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:06:50.423271 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:50.423271 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:50.423271 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:50.423271 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:50.423271 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:50.423271 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:50.423271 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:50.423271 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:50.423271 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:50.423271 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:50.423271 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:50.423271 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:06:50.423271 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:06:50.423271 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:06:50.424189 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:06:50.424189 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:50.424189 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:50.424189 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:50.424189 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:50.424189 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:50.424189 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:50.424189 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:50.424189 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:50.424189 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:50.424189 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:50.424189 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:50.424189 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:50.424189 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:50.424189 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:50.424189 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:50.424189 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:50.425085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:06:50.425085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:06:50.425085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:06:50.425085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:06:50.425085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:06:50.425085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:06:50.425085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:06:50.425085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:50.427498 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 351/723] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:06:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:50.433972 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273146c1-cebd-490e-9ffc-25d3127b4924 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:50.454049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:50.458835 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3f7b2-8b78-437b-aa55-a97cc8d62c25 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:50.459128 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3f7b2-8b78-437b-aa55-a97cc8d62c25 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:50.459416 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3f7b2-8b78-437b-aa55-a97cc8d62c25 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:50.461094 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 352/724] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:50.469937 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165f34e-3460-403a-85e9-becdac8bfe26 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:50.470273 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165f34e-3460-403a-85e9-becdac8bfe26 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:50.470511 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165f34e-3460-403a-85e9-becdac8bfe26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:50.489726 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-5165f34e-3460-403a-85e9-becdac8bfe26 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:50.491020 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-5165f34e-3460-403a-85e9-becdac8bfe26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:50.560675 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273146c1-cebd-490e-9ffc-25d3127b4924 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:50.563379 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 353/725] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:50 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:06:50.597477 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c1b14-3156-4be9-975d-e5de2a0fefdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:50.598073 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c1b14-3156-4be9-975d-e5de2a0fefdf None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:50.598352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c1b14-3156-4be9-975d-e5de2a0fefdf None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:50.598623 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c1b14-3156-4be9-975d-e5de2a0fefdf None admin] PATH_INFO: `/v3/projects` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:50.599341 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c1b14-3156-4be9-975d-e5de2a0fefdf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:50.599654 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c1b14-3156-4be9-975d-e5de2a0fefdf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:50.601127 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c1b14-3156-4be9-975d-e5de2a0fefdf None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:50.614680 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 373/726] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 9 11:06:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:50.620561 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165f34e-3460-403a-85e9-becdac8bfe26 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:50.702237 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:50.729461 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165f34e-3460-403a-85e9-becdac8bfe26 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:50.767766 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5ebb8-298d-49e4-bd25-97836ba40b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:50.768379 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5ebb8-298d-49e4-bd25-97836ba40b7b None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:50.768658 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5ebb8-298d-49e4-bd25-97836ba40b7b None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:50.768931 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5ebb8-298d-49e4-bd25-97836ba40b7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:50.769679 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5ebb8-298d-49e4-bd25-97836ba40b7b None admin] RBAC: Adding query filter params (role.id=b02ba8c157bf46f4a75cdab917db78db, scope.project.id=b9cec15abcd74e13ba458c64ad6fdf9b, user.id=417acfbae1244469961371115a42498e) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:50.769986 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5ebb8-298d-49e4-bd25-97836ba40b7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:50.771405 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5ebb8-298d-49e4-bd25-97836ba40b7b None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:50.778192 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 354/727] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:06:50 2022] GET /identity/v3/role_assignments?user.id=417acfbae1244469961371115a42498e&scope.project.id=b9cec15abcd74e13ba458c64ad6fdf9b&role.id=b02ba8c157bf46f4a75cdab917db78db => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:50.907010 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c1b14-3156-4be9-975d-e5de2a0fefdf None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:50.999098 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:51.024477 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c1b14-3156-4be9-975d-e5de2a0fefdf None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:51.061640 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fd3fa-f7bf-47c3-a95e-15578372326d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:51.062660 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fd3fa-f7bf-47c3-a95e-15578372326d None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:51.063143 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fd3fa-f7bf-47c3-a95e-15578372326d None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:51.063613 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fd3fa-f7bf-47c3-a95e-15578372326d None admin] PATH_INFO: `/v3/services/image` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:51.064388 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95fd3fa-f7bf-47c3-a95e-15578372326d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:51.065990 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95fd3fa-f7bf-47c3-a95e-15578372326d None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:51.076183 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-c95fd3fa-f7bf-47c3-a95e-15578372326d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 11:06:51.076183 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:51.076183 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:06:51.076183 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:06:51.076183 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:06:51.076183 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:06:51.076183 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:06:51.076183 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:06:51.076183 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 11:06:51.076183 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:51.076183 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:06:51.076183 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:51.076183 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:51.076183 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:51.076183 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:51.076183 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:51.076183 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:51.077207 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:51.077207 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:51.077207 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:51.077207 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:51.077207 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:51.077207 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:51.077207 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:06:51.077207 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:06:51.077207 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:06:51.077207 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:06:51.077207 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:51.077207 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:51.077207 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:51.077207 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:51.077207 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:51.077207 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:51.078077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:51.078077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:51.078077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:51.078077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:51.078077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:51.078077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:51.078077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:51.078077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:51.078077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:51.078077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:51.078077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:06:51.078077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:06:51.078077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 11:06:51.078077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:51.085410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 374/728] 10.222.0.20 () {56 vars in 1105 bytes} [Fri Sep 9 11:06:50 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:51.086975 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5ebb8-298d-49e4-bd25-97836ba40b7b None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:51.194767 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5ebb8-298d-49e4-bd25-97836ba40b7b None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:51.232554 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745682a9-6554-4118-97ed-3194391b74e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:51.233689 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745682a9-6554-4118-97ed-3194391b74e5 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:51.234195 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745682a9-6554-4118-97ed-3194391b74e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:51.234669 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745682a9-6554-4118-97ed-3194391b74e5 None admin] PATH_INFO: `/v3/services` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:51.235550 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745682a9-6554-4118-97ed-3194391b74e5 None admin] RBAC: Adding query filter params (name=image) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:51.236051 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745682a9-6554-4118-97ed-3194391b74e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:51.237701 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745682a9-6554-4118-97ed-3194391b74e5 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:51.248484 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 355/729] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:51.250181 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fd3fa-f7bf-47c3-a95e-15578372326d None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:51.360262 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2d577-941b-4a9a-a2c2-460e2ad15631 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:51.360908 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2d577-941b-4a9a-a2c2-460e2ad15631 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:51.361454 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2d577-941b-4a9a-a2c2-460e2ad15631 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:51.363267 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 356/730] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:06:51.367508 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fd3fa-f7bf-47c3-a95e-15578372326d None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:51.369026 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60d454-bef3-43b4-bdb1-df210311619c None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:51.369575 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60d454-bef3-43b4-bdb1-df210311619c None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:51.370043 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60d454-bef3-43b4-bdb1-df210311619c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:51.383897 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:51.393912 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-0a60d454-bef3-43b4-bdb1-df210311619c None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:51.395929 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-0a60d454-bef3-43b4-bdb1-df210311619c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:51.407798 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42171cfc-0586-45e4-8415-b40bc77adbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:51.408418 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42171cfc-0586-45e4-8415-b40bc77adbdb None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:51.408696 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42171cfc-0586-45e4-8415-b40bc77adbdb None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:51.408973 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42171cfc-0586-45e4-8415-b40bc77adbdb None admin] PATH_INFO: `/v3/services` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:51.409648 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42171cfc-0586-45e4-8415-b40bc77adbdb None admin] RBAC: Adding query filter params (type=image) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:51.409951 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42171cfc-0586-45e4-8415-b40bc77adbdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:51.412426 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42171cfc-0586-45e4-8415-b40bc77adbdb None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:51.420307 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 375/731] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:51.430284 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42171cfc-0586-45e4-8415-b40bc77adbdb None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:51.444419 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:51.508160 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 357/732] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:51 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:06:51.679593 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42171cfc-0586-45e4-8415-b40bc77adbdb None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:51.717178 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce53aa3-9708-4bbb-9bb7-4ef320727c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:51.717825 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce53aa3-9708-4bbb-9bb7-4ef320727c8f None admin] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:51.718140 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce53aa3-9708-4bbb-9bb7-4ef320727c8f None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:51.718362 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce53aa3-9708-4bbb-9bb7-4ef320727c8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:51.719027 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce53aa3-9708-4bbb-9bb7-4ef320727c8f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:51.720384 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce53aa3-9708-4bbb-9bb7-4ef320727c8f None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:51.746582 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 376/733] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 9 11:06:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:06:51.834227 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60d454-bef3-43b4-bdb1-df210311619c None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:51.906096 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d36ad-0c9c-468a-95fd-496df6e453f3 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:51.906383 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d36ad-0c9c-468a-95fd-496df6e453f3 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:51.906656 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d36ad-0c9c-468a-95fd-496df6e453f3 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:51.908173 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 377/734] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:51.915042 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7604b78-cae9-4c82-a5e2-0ae469cde1e0 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:51.915315 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7604b78-cae9-4c82-a5e2-0ae469cde1e0 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:51.915593 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7604b78-cae9-4c82-a5e2-0ae469cde1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:51.938604 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-a7604b78-cae9-4c82-a5e2-0ae469cde1e0 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:51.940073 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-a7604b78-cae9-4c82-a5e2-0ae469cde1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:51.958775 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60d454-bef3-43b4-bdb1-df210311619c None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:51.995625 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:52.009591 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f4506-c856-4981-a5b4-46f06b028e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:52.011112 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f4506-c856-4981-a5b4-46f06b028e15 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:52.011112 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f4506-c856-4981-a5b4-46f06b028e15 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:52.011112 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f4506-c856-4981-a5b4-46f06b028e15 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:52.012435 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f4506-c856-4981-a5b4-46f06b028e15 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:52.013258 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:52.014245 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f4506-c856-4981-a5b4-46f06b028e15 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:52.025786 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-9f7f4506-c856-4981-a5b4-46f06b028e15 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:06:52.025786 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:52.025786 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:06:52.025786 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:06:52.025786 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:06:52.025786 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:06:52.025786 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:06:52.025786 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:06:52.025786 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:06:52.025786 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:52.025786 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:06:52.025786 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:52.025786 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:52.025786 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:52.025786 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:52.025786 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:52.025786 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:52.026900 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:52.026900 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:52.026900 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:52.026900 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:52.026900 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:52.026900 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:52.026900 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:06:52.026900 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:06:52.026900 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:06:52.026900 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:06:52.026900 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:52.026900 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:52.026900 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:52.026900 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:52.026900 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:52.026900 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:52.028064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:52.028064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:52.028064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:52.028064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:52.028064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:52.028064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:52.028064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:52.028064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:52.028064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:52.028064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:52.028064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:06:52.028064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:06:52.028064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:06:52.028064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:52.028064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 358/735] 10.222.0.20 () {56 vars in 1129 bytes} [Fri Sep 9 11:06:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:52.032940 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 378/736] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:51 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:06:52.034274 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f4506-c856-4981-a5b4-46f06b028e15 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:52.151793 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f4506-c856-4981-a5b4-46f06b028e15 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:52.188346 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7a58b-f257-4584-be14-aa2a7df4b700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:52.189261 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7a58b-f257-4584-be14-aa2a7df4b700 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:52.189804 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7a58b-f257-4584-be14-aa2a7df4b700 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:52.190279 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7a58b-f257-4584-be14-aa2a7df4b700 None admin] PATH_INFO: `/v3/services` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:52.191082 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7a58b-f257-4584-be14-aa2a7df4b700 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:52.191557 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7a58b-f257-4584-be14-aa2a7df4b700 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:52.193308 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7a58b-f257-4584-be14-aa2a7df4b700 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:52.198580 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 359/737] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Sep 9 11:06:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:52.206245 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7604b78-cae9-4c82-a5e2-0ae469cde1e0 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:52.325646 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7604b78-cae9-4c82-a5e2-0ae469cde1e0 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:52.360685 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90968dc7-5c83-4d78-b9d3-fbb3abe7ba40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:52.361301 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90968dc7-5c83-4d78-b9d3-fbb3abe7ba40 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:52.361622 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90968dc7-5c83-4d78-b9d3-fbb3abe7ba40 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:52.361898 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90968dc7-5c83-4d78-b9d3-fbb3abe7ba40 None admin] PATH_INFO: `/v3/services` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:52.362521 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90968dc7-5c83-4d78-b9d3-fbb3abe7ba40 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:52.362817 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90968dc7-5c83-4d78-b9d3-fbb3abe7ba40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:52.364229 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90968dc7-5c83-4d78-b9d3-fbb3abe7ba40 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:52.369393 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 379/738] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Sep 9 11:06:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:52.375037 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7a58b-f257-4584-be14-aa2a7df4b700 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:52.378451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90968dc7-5c83-4d78-b9d3-fbb3abe7ba40 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:52.441872 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:52.454083 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:52.496995 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90968dc7-5c83-4d78-b9d3-fbb3abe7ba40 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:52.507842 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7a58b-f257-4584-be14-aa2a7df4b700 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:52.534442 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0766d6-d8df-4197-a60e-76a7fb49feb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:52.535059 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0766d6-d8df-4197-a60e-76a7fb49feb7 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:52.535333 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0766d6-d8df-4197-a60e-76a7fb49feb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:52.535599 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0766d6-d8df-4197-a60e-76a7fb49feb7 None admin] PATH_INFO: `/v3/services/network` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:52.536166 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0766d6-d8df-4197-a60e-76a7fb49feb7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:52.538373 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0766d6-d8df-4197-a60e-76a7fb49feb7 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:52.551592 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-9a0766d6-d8df-4197-a60e-76a7fb49feb7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:06:52.551592 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:52.551592 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:06:52.551592 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:06:52.551592 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:06:52.551592 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:06:52.551592 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:06:52.551592 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:06:52.551592 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:06:52.551592 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:52.551592 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:06:52.551592 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:52.551592 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:52.551592 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:52.551592 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:52.551592 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:52.551592 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:52.552615 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:52.552615 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:52.552615 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:52.552615 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:52.552615 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:52.552615 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:52.552615 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:06:52.552615 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:06:52.552615 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:06:52.552615 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:06:52.552615 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:52.552615 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:52.552615 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:52.552615 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:52.552615 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:52.552615 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:52.553574 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:52.553574 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:52.553574 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:52.553574 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:52.553574 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:52.553574 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:52.553574 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:52.553574 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:52.553574 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:52.553574 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:52.553574 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:06:52.553574 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:06:52.553574 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:06:52.553574 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:06:52.553574 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 380/739] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:06:52 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:52.558566 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0766d6-d8df-4197-a60e-76a7fb49feb7 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:52.559841 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a7791-df29-4cdf-ba10-6e1ae22ed406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:52.560682 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a7791-df29-4cdf-ba10-6e1ae22ed406 None admin] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:52.561317 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a7791-df29-4cdf-ba10-6e1ae22ed406 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:52.561809 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a7791-df29-4cdf-ba10-6e1ae22ed406 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:52.562763 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a7791-df29-4cdf-ba10-6e1ae22ed406 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:52.564341 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a7791-df29-4cdf-ba10-6e1ae22ed406 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:52.590863 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 360/740] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 9 11:06:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:06:52.682336 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0766d6-d8df-4197-a60e-76a7fb49feb7 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:52.708103 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:52.731933 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c327c3-19f8-4ada-b199-de653b942ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:52.732604 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c327c3-19f8-4ada-b199-de653b942ae2 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:52.732893 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c327c3-19f8-4ada-b199-de653b942ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:52.733163 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c327c3-19f8-4ada-b199-de653b942ae2 None admin] PATH_INFO: `/v3/services` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:52.733836 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c327c3-19f8-4ada-b199-de653b942ae2 None admin] RBAC: Adding query filter params (name=network) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:52.734136 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c327c3-19f8-4ada-b199-de653b942ae2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:52.735635 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c327c3-19f8-4ada-b199-de653b942ae2 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:52.741570 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 381/741] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 9 11:06:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:52.748144 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a7791-df29-4cdf-ba10-6e1ae22ed406 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:52.869727 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a7791-df29-4cdf-ba10-6e1ae22ed406 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:52.884811 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:52.909841 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f643f-00c2-4068-a75b-3202a389a8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:52.910449 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f643f-00c2-4068-a75b-3202a389a8d8 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:52.910727 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f643f-00c2-4068-a75b-3202a389a8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:52.910993 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f643f-00c2-4068-a75b-3202a389a8d8 None admin] PATH_INFO: `/v3/services` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:52.911618 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f643f-00c2-4068-a75b-3202a389a8d8 None admin] RBAC: Adding query filter params (type=network) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:52.911916 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f643f-00c2-4068-a75b-3202a389a8d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:52.913295 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f643f-00c2-4068-a75b-3202a389a8d8 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:52.919578 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 361/742] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 9 11:06:52 2022] GET /identity/v3/services?type=network => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:52.925232 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c327c3-19f8-4ada-b199-de653b942ae2 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:53.038661 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c327c3-19f8-4ada-b199-de653b942ae2 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:53.073556 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df4048-de5a-49d1-ad0b-d6d2237d9f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:53.074700 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df4048-de5a-49d1-ad0b-d6d2237d9f7f None admin] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:53.074978 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df4048-de5a-49d1-ad0b-d6d2237d9f7f None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:53.075245 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df4048-de5a-49d1-ad0b-d6d2237d9f7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:53.075976 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df4048-de5a-49d1-ad0b-d6d2237d9f7f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:53.077350 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df4048-de5a-49d1-ad0b-d6d2237d9f7f None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:53.100197 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 382/743] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 9 11:06:52 2022] POST /identity/v3/endpoints => generated 337 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:06:53.397567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038eec2-5164-4a74-a957-36ef65ac649f None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:53.398095 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038eec2-5164-4a74-a957-36ef65ac649f None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:53.398095 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038eec2-5164-4a74-a957-36ef65ac649f None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:53.399713 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 362/744] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:53.405694 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f6ce6-99cc-4f0c-bcb5-971814db5786 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:53.405990 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f6ce6-99cc-4f0c-bcb5-971814db5786 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:53.406270 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f6ce6-99cc-4f0c-bcb5-971814db5786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:53.427348 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-b13f6ce6-99cc-4f0c-bcb5-971814db5786 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:53.428872 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-b13f6ce6-99cc-4f0c-bcb5-971814db5786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:53.461942 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:53.507495 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 383/745] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:53 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:06:53.840454 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038eec2-5164-4a74-a957-36ef65ac649f None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:53.949785 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038eec2-5164-4a74-a957-36ef65ac649f None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:53.985766 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bede99f-6d42-469e-9a08-a6ee83894cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:53.986462 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bede99f-6d42-469e-9a08-a6ee83894cae None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:53.986808 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bede99f-6d42-469e-9a08-a6ee83894cae None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:53.987081 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bede99f-6d42-469e-9a08-a6ee83894cae None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:53.987661 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bede99f-6d42-469e-9a08-a6ee83894cae None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:53.989076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bede99f-6d42-469e-9a08-a6ee83894cae None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:53.998795 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-0bede99f-6d42-469e-9a08-a6ee83894cae None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:06:53.998795 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:53.998795 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:06:53.998795 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:06:53.998795 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:06:53.998795 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:06:53.998795 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:06:53.998795 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:06:53.998795 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:06:53.998795 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:53.998795 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:06:53.998795 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:53.998795 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:53.998795 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:53.998795 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:53.998795 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:53.999763 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:53.999763 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:53.999763 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:53.999763 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:53.999763 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:53.999763 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:53.999763 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:53.999763 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:06:53.999763 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:06:53.999763 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:06:53.999763 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:06:53.999763 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:53.999763 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:53.999763 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:53.999763 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:53.999763 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:53.999763 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:54.000652 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:54.000652 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:54.000652 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:54.000652 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:54.000652 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:54.000652 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:54.000652 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:54.000652 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:54.000652 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:54.000652 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:54.000652 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:06:54.000652 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:06:54.000652 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:06:54.000652 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:54.007981 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 363/746] 10.222.0.20 () {56 vars in 1132 bytes} [Fri Sep 9 11:06:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:54.008129 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f6ce6-99cc-4f0c-bcb5-971814db5786 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:54.113386 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f6ce6-99cc-4f0c-bcb5-971814db5786 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:54.147698 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1755fb3-d167-4b23-9073-7ae8619e1610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:54.148305 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1755fb3-d167-4b23-9073-7ae8619e1610 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:54.148581 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1755fb3-d167-4b23-9073-7ae8619e1610 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:54.148851 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1755fb3-d167-4b23-9073-7ae8619e1610 None admin] PATH_INFO: `/v3/services` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:54.149497 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1755fb3-d167-4b23-9073-7ae8619e1610 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:54.149795 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1755fb3-d167-4b23-9073-7ae8619e1610 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:54.151150 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1755fb3-d167-4b23-9073-7ae8619e1610 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:54.156404 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 384/747] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 9 11:06:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:54.162007 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bede99f-6d42-469e-9a08-a6ee83894cae None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:54.212568 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:54.278429 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bede99f-6d42-469e-9a08-a6ee83894cae None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:54.320393 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d6666-1ad7-40b2-bb61-82b0181d3ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:54.321017 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d6666-1ad7-40b2-bb61-82b0181d3ad8 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:54.321316 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d6666-1ad7-40b2-bb61-82b0181d3ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:54.321601 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d6666-1ad7-40b2-bb61-82b0181d3ad8 None admin] PATH_INFO: `/v3/services` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:54.322227 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d6666-1ad7-40b2-bb61-82b0181d3ad8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:54.322528 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d6666-1ad7-40b2-bb61-82b0181d3ad8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:54.324591 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d6666-1ad7-40b2-bb61-82b0181d3ad8 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:54.337622 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 364/748] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 9 11:06:54 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:54.365444 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9115b-50f2-483b-9edf-b192d9c4e3b2 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:54.365645 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9115b-50f2-483b-9edf-b192d9c4e3b2 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:54.365913 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9115b-50f2-483b-9edf-b192d9c4e3b2 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:54.367272 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 385/749] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:54.373659 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32990bda-4d58-4446-a0a8-c963e8d20842 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:54.373960 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32990bda-4d58-4446-a0a8-c963e8d20842 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:54.374204 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32990bda-4d58-4446-a0a8-c963e8d20842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:54.392750 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-32990bda-4d58-4446-a0a8-c963e8d20842 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:54.394000 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-32990bda-4d58-4446-a0a8-c963e8d20842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:54.473482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 365/750] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:54 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:06:54.787295 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9115b-50f2-483b-9edf-b192d9c4e3b2 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:54.819109 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:54.895472 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9115b-50f2-483b-9edf-b192d9c4e3b2 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:54.935120 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddbdde9-4a1b-45ed-a7b7-3a672ab79d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:54.935726 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddbdde9-4a1b-45ed-a7b7-3a672ab79d10 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:54.935997 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddbdde9-4a1b-45ed-a7b7-3a672ab79d10 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:54.936289 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddbdde9-4a1b-45ed-a7b7-3a672ab79d10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:55.003275 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddbdde9-4a1b-45ed-a7b7-3a672ab79d10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:55.004707 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddbdde9-4a1b-45ed-a7b7-3a672ab79d10 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:55.030747 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:55.112448 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 386/751] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:06:54 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:06:55.113747 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32990bda-4d58-4446-a0a8-c963e8d20842 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:55.148880 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:55.162045 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38d96f-b0c9-40bf-8a7f-33c32f5a51ba None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:55.162322 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38d96f-b0c9-40bf-8a7f-33c32f5a51ba None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:55.162609 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38d96f-b0c9-40bf-8a7f-33c32f5a51ba None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:55.164060 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 387/752] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:06:55.169525 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296a91e-7592-44de-bd38-448c1b514d65 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:55.169818 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296a91e-7592-44de-bd38-448c1b514d65 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:55.170087 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296a91e-7592-44de-bd38-448c1b514d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:55.191196 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-5296a91e-7592-44de-bd38-448c1b514d65 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:55.192364 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-5296a91e-7592-44de-bd38-448c1b514d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:55.220894 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32990bda-4d58-4446-a0a8-c963e8d20842 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:55.254804 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f134a-b311-4a21-a478-7e2fb84905d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:55.255411 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f134a-b311-4a21-a478-7e2fb84905d7 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:55.255689 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f134a-b311-4a21-a478-7e2fb84905d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:55.255964 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f134a-b311-4a21-a478-7e2fb84905d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:55.266487 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f134a-b311-4a21-a478-7e2fb84905d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:55.267267 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 388/753] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:55 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:06:55.267990 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f134a-b311-4a21-a478-7e2fb84905d7 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:55.286841 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-443f134a-b311-4a21-a478-7e2fb84905d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:55.286841 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:55.286841 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:55.286841 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:55.286841 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:55.286841 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:55.286841 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:55.286841 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:55.286841 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:55.286841 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:55.286841 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:55.286841 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:55.286841 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:06:55.286841 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:06:55.286841 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:06:55.286841 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:06:55.293664 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:55.293664 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:55.293664 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:55.293664 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:55.293664 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:55.293664 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:55.293664 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:55.293664 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:55.293664 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:55.293664 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:55.293664 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:55.293664 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:55.293664 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:55.293664 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:55.293664 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:55.293664 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:55.293664 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:06:55.294990 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:06:55.294990 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:06:55.294990 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:55.294990 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 366/754] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:06:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:55.296872 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296a91e-7592-44de-bd38-448c1b514d65 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:55.363676 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:55.408450 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296a91e-7592-44de-bd38-448c1b514d65 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:55.444732 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f81e10-728b-4bda-b516-904c4d8bae58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:55.445361 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f81e10-728b-4bda-b516-904c4d8bae58 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:55.445640 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f81e10-728b-4bda-b516-904c4d8bae58 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:55.445910 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f81e10-728b-4bda-b516-904c4d8bae58 None admin] PATH_INFO: `/v3/domains` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:55.446545 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f81e10-728b-4bda-b516-904c4d8bae58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:55.446843 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f81e10-728b-4bda-b516-904c4d8bae58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:55.448186 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f81e10-728b-4bda-b516-904c4d8bae58 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:55.459685 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 389/755] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:06:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:55.599043 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f134a-b311-4a21-a478-7e2fb84905d7 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:55.692914 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:55.709349 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f134a-b311-4a21-a478-7e2fb84905d7 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:55.745270 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5425e28-7574-46c4-bf22-d8720e829826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:55.746465 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5425e28-7574-46c4-bf22-d8720e829826 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:55.746753 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5425e28-7574-46c4-bf22-d8720e829826 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:55.747022 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5425e28-7574-46c4-bf22-d8720e829826 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:55.747599 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5425e28-7574-46c4-bf22-d8720e829826 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:55.748966 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5425e28-7574-46c4-bf22-d8720e829826 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:55.758164 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-c5425e28-7574-46c4-bf22-d8720e829826 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:06:55.758164 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:55.758164 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:06:55.758164 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:06:55.758164 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:06:55.758164 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:06:55.758164 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:06:55.758164 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:06:55.758164 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:06:55.758164 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:55.758164 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:06:55.758164 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:55.758164 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:06:55.758164 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:06:55.758164 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:06:55.758164 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:06:55.758164 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:06:55.759436 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:06:55.759436 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:06:55.759436 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:06:55.759436 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:06:55.759436 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:06:55.759436 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:06:55.759436 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:06:55.759436 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:06:55.759436 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:06:55.759436 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:06:55.759436 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:06:55.759436 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:06:55.759436 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:06:55.759436 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:06:55.759436 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:06:55.759436 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:06:55.760513 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:06:55.760513 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:06:55.760513 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:06:55.760513 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:06:55.760513 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:06:55.760513 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:06:55.760513 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:06:55.760513 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:06:55.760513 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:06:55.760513 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:06:55.760513 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:06:55.760513 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:06:55.760513 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:06:55.760513 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:06:55.760513 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 367/756] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 9 11:06:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:06:55.766008 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f81e10-728b-4bda-b516-904c4d8bae58 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:55.877589 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f81e10-728b-4bda-b516-904c4d8bae58 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:55.893651 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:55.911076 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509655a-e3a8-44ca-9d06-4aaa50f6e58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:55.911670 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509655a-e3a8-44ca-9d06-4aaa50f6e58c None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:55.911946 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509655a-e3a8-44ca-9d06-4aaa50f6e58c None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:55.912213 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509655a-e3a8-44ca-9d06-4aaa50f6e58c None admin] PATH_INFO: `/v3/services` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:55.912823 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509655a-e3a8-44ca-9d06-4aaa50f6e58c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:55.913118 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509655a-e3a8-44ca-9d06-4aaa50f6e58c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:55.914502 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509655a-e3a8-44ca-9d06-4aaa50f6e58c None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:55.919674 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 390/757] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 9 11:06:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:06:55.925548 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5425e28-7574-46c4-bf22-d8720e829826 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:56.026977 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5425e28-7574-46c4-bf22-d8720e829826 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:56.063414 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40cc1d-744a-4aaa-b50a-fc5247dc5061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:56.064026 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40cc1d-744a-4aaa-b50a-fc5247dc5061 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:56.064306 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40cc1d-744a-4aaa-b50a-fc5247dc5061 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:56.064578 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40cc1d-744a-4aaa-b50a-fc5247dc5061 None admin] PATH_INFO: `/v3/services` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:56.065206 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40cc1d-744a-4aaa-b50a-fc5247dc5061 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:06:56.065548 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40cc1d-744a-4aaa-b50a-fc5247dc5061 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:56.066915 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40cc1d-744a-4aaa-b50a-fc5247dc5061 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:56.071403 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 368/758] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 9 11:06:55 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:06:56.878010 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a8a97-5043-442f-b693-dcf150d2453e None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:56.878570 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a8a97-5043-442f-b693-dcf150d2453e None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:56.878570 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a8a97-5043-442f-b693-dcf150d2453e None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:56.880017 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 391/759] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:56.885100 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb03f62-c4c2-43c1-89b9-d6a405eeda6a None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:56.885549 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb03f62-c4c2-43c1-89b9-d6a405eeda6a None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:56.885683 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb03f62-c4c2-43c1-89b9-d6a405eeda6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:56.904517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-4eb03f62-c4c2-43c1-89b9-d6a405eeda6a None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:56.905772 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-4eb03f62-c4c2-43c1-89b9-d6a405eeda6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:56.916746 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:56.980543 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 369/760] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:56 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:06:57.306432 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a8a97-5043-442f-b693-dcf150d2453e None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:57.418515 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a8a97-5043-442f-b693-dcf150d2453e None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:57.451562 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8034c9b-4195-4160-acec-b9d545eb6393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:57.452168 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8034c9b-4195-4160-acec-b9d545eb6393 None admin] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:57.452445 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8034c9b-4195-4160-acec-b9d545eb6393 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:57.452719 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8034c9b-4195-4160-acec-b9d545eb6393 None admin] PATH_INFO: `/v3/services` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:57.453388 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8034c9b-4195-4160-acec-b9d545eb6393 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:57.454736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8034c9b-4195-4160-acec-b9d545eb6393 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:57.469456 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 392/761] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 9 11:06:57 2022] POST /identity/v3/services => generated 269 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:06:58.467627 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636b11c-c783-4663-9cf4-bcd0296b36d1 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:58.468194 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636b11c-c783-4663-9cf4-bcd0296b36d1 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:58.468194 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636b11c-c783-4663-9cf4-bcd0296b36d1 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:58.469607 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 370/762] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:58.475207 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e3343-143d-46b9-aa5c-141b05ad3866 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:58.475684 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e3343-143d-46b9-aa5c-141b05ad3866 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:58.475785 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e3343-143d-46b9-aa5c-141b05ad3866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:58.494411 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-609e3343-143d-46b9-aa5c-141b05ad3866 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:58.496143 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-609e3343-143d-46b9-aa5c-141b05ad3866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:06:58.530740 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:58.575804 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 393/763] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:58 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:06:58.896145 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636b11c-c783-4663-9cf4-bcd0296b36d1 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:06:59.003369 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636b11c-c783-4663-9cf4-bcd0296b36d1 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:06:59.037437 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660120bc-c8e8-43d8-be00-9b9932403a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:06:59.038040 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660120bc-c8e8-43d8-be00-9b9932403a1e None admin] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:59.038317 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660120bc-c8e8-43d8-be00-9b9932403a1e None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:59.038585 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660120bc-c8e8-43d8-be00-9b9932403a1e None admin] PATH_INFO: `/v3/services` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:59.039226 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660120bc-c8e8-43d8-be00-9b9932403a1e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:06:59.040592 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660120bc-c8e8-43d8-be00-9b9932403a1e None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:06:59.056228 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 371/764] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 9 11:06:58 2022] POST /identity/v3/services => generated 251 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:06:59.909134 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475e4ce-b1e2-4b19-9b78-2bf47d48748b None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:59.909789 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475e4ce-b1e2-4b19-9b78-2bf47d48748b None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:59.909789 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475e4ce-b1e2-4b19-9b78-2bf47d48748b None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:59.911012 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 394/765] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:06:59.916354 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd9559-0526-4e18-82c6-3ed8c203cc1a None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:59.916781 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd9559-0526-4e18-82c6-3ed8c203cc1a None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:59.916913 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd9559-0526-4e18-82c6-3ed8c203cc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:59.924420 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:06:59.936746 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-72cd9559-0526-4e18-82c6-3ed8c203cc1a None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:06:59.937975 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-72cd9559-0526-4e18-82c6-3ed8c203cc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:00.013237 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 372/766] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:06:59 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:07:00.331877 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475e4ce-b1e2-4b19-9b78-2bf47d48748b None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:00.430546 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475e4ce-b1e2-4b19-9b78-2bf47d48748b None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:00.463071 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4a0a5-910e-49e2-b710-964790091add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:00.463689 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4a0a5-910e-49e2-b710-964790091add None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:00.463963 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4a0a5-910e-49e2-b710-964790091add None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:00.464252 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4a0a5-910e-49e2-b710-964790091add None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:00.464845 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae4a0a5-910e-49e2-b710-964790091add None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:00.466223 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae4a0a5-910e-49e2-b710-964790091add None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:00.474756 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-bae4a0a5-910e-49e2-b710-964790091add None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:07:00.474756 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:00.474756 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:07:00.474756 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:07:00.474756 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:07:00.474756 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:07:00.474756 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:07:00.474756 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:07:00.474756 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:07:00.474756 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:07:00.474756 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:07:00.474756 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:07:00.474756 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:00.474756 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:00.474756 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:00.474756 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:00.475803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:00.475803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:00.475803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:00.475803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:00.475803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:00.475803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:00.475803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:00.475803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:07:00.475803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:07:00.475803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:07:00.475803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:07:00.475803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:00.475803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:00.475803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:00.475803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:00.475803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:00.475803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:00.476718 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:00.476718 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:00.476718 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:00.476718 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:00.476718 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:00.476718 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:00.476718 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:00.476718 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:00.476718 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:00.476718 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:00.476718 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:07:00.476718 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:07:00.476718 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:07:00.476718 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:07:00.476718 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 395/767] 10.222.0.20 () {56 vars in 1132 bytes} [Fri Sep 9 11:07:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:00.482206 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd9559-0526-4e18-82c6-3ed8c203cc1a None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:00.578338 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd9559-0526-4e18-82c6-3ed8c203cc1a None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:00.605873 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:00.612154 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5883d7-155d-4de5-a921-87fc6e8755a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:00.612761 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5883d7-155d-4de5-a921-87fc6e8755a4 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:00.613041 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5883d7-155d-4de5-a921-87fc6e8755a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:00.613336 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5883d7-155d-4de5-a921-87fc6e8755a4 None admin] PATH_INFO: `/v3/services` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:00.613964 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5883d7-155d-4de5-a921-87fc6e8755a4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:00.614263 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5883d7-155d-4de5-a921-87fc6e8755a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:00.615622 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5883d7-155d-4de5-a921-87fc6e8755a4 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:00.620194 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 373/768] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 9 11:07:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:00.626610 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4a0a5-910e-49e2-b710-964790091add None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:00.656436 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:00.723920 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4a0a5-910e-49e2-b710-964790091add None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:00.755925 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9aaa2-a6e6-42dc-8045-7baf284529d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:00.756514 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9aaa2-a6e6-42dc-8045-7baf284529d1 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:00.756790 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9aaa2-a6e6-42dc-8045-7baf284529d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:00.757054 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9aaa2-a6e6-42dc-8045-7baf284529d1 None admin] PATH_INFO: `/v3/services` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:00.757697 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9aaa2-a6e6-42dc-8045-7baf284529d1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:00.757993 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9aaa2-a6e6-42dc-8045-7baf284529d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:00.759327 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9aaa2-a6e6-42dc-8045-7baf284529d1 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:00.763955 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 396/769] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 9 11:07:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:00.769744 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5883d7-155d-4de5-a921-87fc6e8755a4 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:00.870079 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5883d7-155d-4de5-a921-87fc6e8755a4 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:00.905928 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbc840-5901-4388-9b6c-303b5f409a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:00.906533 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbc840-5901-4388-9b6c-303b5f409a04 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:00.906810 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbc840-5901-4388-9b6c-303b5f409a04 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:00.907077 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbc840-5901-4388-9b6c-303b5f409a04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:00.907766 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbc840-5901-4388-9b6c-303b5f409a04 None admin] RBAC: Adding query filter params (interface=public, service_id=d92773f891df4eec8dbbd4ba1b45ba69, region_id=RegionOne) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:00.908067 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbc840-5901-4388-9b6c-303b5f409a04 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:00.909441 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbc840-5901-4388-9b6c-303b5f409a04 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:00.914459 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 374/770] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Sep 9 11:07:00 2022] GET /identity/v3/endpoints?service_id=d92773f891df4eec8dbbd4ba1b45ba69&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:00.920484 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9aaa2-a6e6-42dc-8045-7baf284529d1 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:01.011049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:01.018807 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9aaa2-a6e6-42dc-8045-7baf284529d1 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:01.054841 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb02887-cbc1-4ab5-93cb-5cadc95363d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:01.055459 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb02887-cbc1-4ab5-93cb-5cadc95363d6 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:01.055733 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb02887-cbc1-4ab5-93cb-5cadc95363d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:01.055996 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb02887-cbc1-4ab5-93cb-5cadc95363d6 None admin] PATH_INFO: `/v3/services` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:01.056604 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb02887-cbc1-4ab5-93cb-5cadc95363d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:01.058059 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb02887-cbc1-4ab5-93cb-5cadc95363d6 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:01.065235 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 397/771] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 9 11:07:00 2022] GET /identity/v3/services => generated 1498 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:07:01.473501 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa4cd4-2902-49a4-b647-68b749b8706e None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:01.474049 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa4cd4-2902-49a4-b647-68b749b8706e None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:01.474049 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa4cd4-2902-49a4-b647-68b749b8706e None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:01.475412 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 375/772] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:01.481299 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e71a46-0c20-4f1b-8ec1-9580227070f8 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:01.481595 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e71a46-0c20-4f1b-8ec1-9580227070f8 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:01.481874 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e71a46-0c20-4f1b-8ec1-9580227070f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:01.499705 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-22e71a46-0c20-4f1b-8ec1-9580227070f8 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:01.500895 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-22e71a46-0c20-4f1b-8ec1-9580227070f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:01.568923 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 398/773] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:01 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:07:01.895297 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa4cd4-2902-49a4-b647-68b749b8706e None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:01.954780 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:01.997446 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa4cd4-2902-49a4-b647-68b749b8706e None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:02.030146 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09599433-4f67-4b00-b0db-b817b2cebf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:02.030770 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09599433-4f67-4b00-b0db-b817b2cebf95 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:02.031050 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09599433-4f67-4b00-b0db-b817b2cebf95 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:02.031321 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09599433-4f67-4b00-b0db-b817b2cebf95 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:02.031899 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09599433-4f67-4b00-b0db-b817b2cebf95 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:02.033299 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09599433-4f67-4b00-b0db-b817b2cebf95 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:02.041966 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-09599433-4f67-4b00-b0db-b817b2cebf95 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:07:02.041966 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:02.041966 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:07:02.041966 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:07:02.041966 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:07:02.041966 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:07:02.041966 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:07:02.041966 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:07:02.041966 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:07:02.041966 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:07:02.041966 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:07:02.041966 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:07:02.041966 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:02.041966 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:02.041966 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:02.041966 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:02.041966 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:02.043624 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:02.043624 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:02.043624 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:02.043624 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:02.043624 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:02.043624 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:02.043624 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:07:02.043624 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:07:02.043624 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:07:02.043624 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:07:02.043624 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:02.043624 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:02.043624 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:02.043624 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:02.043624 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:02.043624 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:02.044962 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:02.044962 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:02.044962 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:02.044962 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:02.044962 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:02.044962 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:02.044962 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:02.044962 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:02.044962 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:02.044962 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:02.044962 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:07:02.044962 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:07:02.044962 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:07:02.044962 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:07:02.046631 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 376/774] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 9 11:07:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:02.049627 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e71a46-0c20-4f1b-8ec1-9580227070f8 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:02.134039 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:02.146383 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e71a46-0c20-4f1b-8ec1-9580227070f8 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:02.183577 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa56bd2-75fb-4b01-a11c-21a5326d929d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:02.184184 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa56bd2-75fb-4b01-a11c-21a5326d929d None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:02.184462 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa56bd2-75fb-4b01-a11c-21a5326d929d None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:02.184734 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa56bd2-75fb-4b01-a11c-21a5326d929d None admin] PATH_INFO: `/v3/services` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:02.185398 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa56bd2-75fb-4b01-a11c-21a5326d929d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:02.185700 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa56bd2-75fb-4b01-a11c-21a5326d929d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:02.187062 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa56bd2-75fb-4b01-a11c-21a5326d929d None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:02.191757 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 399/775] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 9 11:07:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:02.197698 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09599433-4f67-4b00-b0db-b817b2cebf95 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:02.298452 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09599433-4f67-4b00-b0db-b817b2cebf95 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:02.324745 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:02.336960 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ee675-5459-4d98-a71d-514233a2a10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:02.337598 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ee675-5459-4d98-a71d-514233a2a10c None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:02.337879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ee675-5459-4d98-a71d-514233a2a10c None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:02.338147 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ee675-5459-4d98-a71d-514233a2a10c None admin] PATH_INFO: `/v3/services` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:02.338768 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ee675-5459-4d98-a71d-514233a2a10c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:02.339077 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ee675-5459-4d98-a71d-514233a2a10c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:02.341049 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ee675-5459-4d98-a71d-514233a2a10c None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:02.346304 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 377/776] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 9 11:07:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:07:02.351946 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa56bd2-75fb-4b01-a11c-21a5326d929d None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:02.450392 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa56bd2-75fb-4b01-a11c-21a5326d929d None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:02.483802 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc403592-fdb3-49f5-a956-7b9f6cf46ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:02.484406 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc403592-fdb3-49f5-a956-7b9f6cf46ec4 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:02.484687 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc403592-fdb3-49f5-a956-7b9f6cf46ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:02.484956 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc403592-fdb3-49f5-a956-7b9f6cf46ec4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:02.485683 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc403592-fdb3-49f5-a956-7b9f6cf46ec4 None admin] RBAC: Adding query filter params (interface=public, service_id=6c2020c42974441d9d5fbbd02f397ce4, region_id=RegionOne) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:02.485990 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc403592-fdb3-49f5-a956-7b9f6cf46ec4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:02.487399 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc403592-fdb3-49f5-a956-7b9f6cf46ec4 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:02.492278 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 400/777] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Sep 9 11:07:02 2022] GET /identity/v3/endpoints?service_id=6c2020c42974441d9d5fbbd02f397ce4&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:02.498081 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ee675-5459-4d98-a71d-514233a2a10c None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:02.596177 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ee675-5459-4d98-a71d-514233a2a10c None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:02.627927 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f695a02-c9ab-4173-ab8b-b79126674a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:02.628522 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f695a02-c9ab-4173-ab8b-b79126674a8d None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:02.628797 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f695a02-c9ab-4173-ab8b-b79126674a8d None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:02.629063 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f695a02-c9ab-4173-ab8b-b79126674a8d None admin] PATH_INFO: `/v3/services` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:02.629684 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f695a02-c9ab-4173-ab8b-b79126674a8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:02.631033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f695a02-c9ab-4173-ab8b-b79126674a8d None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:02.637431 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 378/778] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 9 11:07:02 2022] GET /identity/v3/services => generated 1498 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:07:03.509224 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840813f3-43f2-4103-9e36-12e032cf0c41 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:03.509771 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840813f3-43f2-4103-9e36-12e032cf0c41 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:03.509880 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840813f3-43f2-4103-9e36-12e032cf0c41 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:03.511687 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 401/779] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:03.517522 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8941bd1-91a1-4d1f-b914-d599756d9ad0 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:03.517937 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8941bd1-91a1-4d1f-b914-d599756d9ad0 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:03.518097 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8941bd1-91a1-4d1f-b914-d599756d9ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:03.536665 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-b8941bd1-91a1-4d1f-b914-d599756d9ad0 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:03.537874 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-b8941bd1-91a1-4d1f-b914-d599756d9ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:03.583975 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:03.604928 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 379/780] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:03 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:07:03.927374 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840813f3-43f2-4103-9e36-12e032cf0c41 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:03.946182 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:04.030392 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840813f3-43f2-4103-9e36-12e032cf0c41 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:04.064399 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618a6c0-0c2e-45e0-95d9-a37594a2cdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:04.065022 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618a6c0-0c2e-45e0-95d9-a37594a2cdf7 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:04.065322 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618a6c0-0c2e-45e0-95d9-a37594a2cdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:04.065602 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618a6c0-0c2e-45e0-95d9-a37594a2cdf7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:04.066169 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618a6c0-0c2e-45e0-95d9-a37594a2cdf7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:04.067561 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618a6c0-0c2e-45e0-95d9-a37594a2cdf7 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:04.076086 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-e618a6c0-0c2e-45e0-95d9-a37594a2cdf7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:07:04.076086 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:04.076086 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:07:04.076086 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:07:04.076086 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:07:04.076086 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:07:04.076086 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:07:04.076086 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:07:04.076086 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:07:04.076086 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:07:04.076086 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:07:04.076086 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:07:04.076086 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:04.076086 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:04.076086 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:04.076086 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:04.077037 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:04.077037 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:04.077037 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:04.077037 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:04.077037 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:04.077037 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:04.077037 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:04.077037 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:07:04.077037 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:07:04.077037 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:07:04.077037 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:07:04.077037 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:04.077037 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:04.077037 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:04.077037 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:04.077037 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:04.077037 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:04.078070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:04.078070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:04.078070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:04.078070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:04.078070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:04.078070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:04.078070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:04.078070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:04.078070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:04.078070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:04.078070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:07:04.078070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:07:04.078070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:07:04.078070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:07:04.078070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 402/781] 10.222.0.20 () {56 vars in 1132 bytes} [Fri Sep 9 11:07:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:04.083129 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8941bd1-91a1-4d1f-b914-d599756d9ad0 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:04.177980 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8941bd1-91a1-4d1f-b914-d599756d9ad0 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:04.216186 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b40f7-8056-4198-b697-2182b2219b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:04.216797 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b40f7-8056-4198-b697-2182b2219b8f None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:04.217075 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b40f7-8056-4198-b697-2182b2219b8f None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:04.217402 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b40f7-8056-4198-b697-2182b2219b8f None admin] PATH_INFO: `/v3/services` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:04.218035 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b40f7-8056-4198-b697-2182b2219b8f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:04.218335 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b40f7-8056-4198-b697-2182b2219b8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:04.219704 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b40f7-8056-4198-b697-2182b2219b8f None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:04.224571 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 380/782] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 9 11:07:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:04.230251 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618a6c0-0c2e-45e0-95d9-a37594a2cdf7 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:04.311449 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:04.335628 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618a6c0-0c2e-45e0-95d9-a37594a2cdf7 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:04.369543 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6cd44-78ae-4a37-87b5-73b61b68b449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:04.370147 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6cd44-78ae-4a37-87b5-73b61b68b449 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:04.371021 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6cd44-78ae-4a37-87b5-73b61b68b449 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:04.371288 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6cd44-78ae-4a37-87b5-73b61b68b449 None admin] PATH_INFO: `/v3/services` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:04.375950 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6cd44-78ae-4a37-87b5-73b61b68b449 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:04.375950 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6cd44-78ae-4a37-87b5-73b61b68b449 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:04.375950 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6cd44-78ae-4a37-87b5-73b61b68b449 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:04.383015 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 403/783] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 9 11:07:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:04.389426 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b40f7-8056-4198-b697-2182b2219b8f None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:04.435908 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:04.489421 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b40f7-8056-4198-b697-2182b2219b8f None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:04.522029 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b99d4-9ea8-4658-a0b1-e1ed081eb45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:04.522682 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b99d4-9ea8-4658-a0b1-e1ed081eb45c None admin] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:04.522893 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b99d4-9ea8-4658-a0b1-e1ed081eb45c None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:04.523160 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b99d4-9ea8-4658-a0b1-e1ed081eb45c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:04.523834 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b99d4-9ea8-4658-a0b1-e1ed081eb45c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:04.525189 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b99d4-9ea8-4658-a0b1-e1ed081eb45c None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:04.545702 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 381/784] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 9 11:07:04 2022] POST /identity/v3/endpoints => generated 347 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:07:05.085710 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4e8c4-46c7-447a-9e79-e6f891149b53 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:05.086257 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4e8c4-46c7-447a-9e79-e6f891149b53 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:05.086257 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4e8c4-46c7-447a-9e79-e6f891149b53 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:05.087572 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 404/785] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:05.092808 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67866b-7f73-4dd0-b720-352f9338fbe2 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:05.093093 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67866b-7f73-4dd0-b720-352f9338fbe2 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:05.093406 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67866b-7f73-4dd0-b720-352f9338fbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:05.111874 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-0e67866b-7f73-4dd0-b720-352f9338fbe2 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:05.113056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-0e67866b-7f73-4dd0-b720-352f9338fbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:05.185552 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 382/786] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:05 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:07:05.514972 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4e8c4-46c7-447a-9e79-e6f891149b53 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:05.619595 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4e8c4-46c7-447a-9e79-e6f891149b53 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:05.655722 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71ab18-6213-4925-8211-f6faea395e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:05.656499 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71ab18-6213-4925-8211-f6faea395e9c None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:05.656882 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71ab18-6213-4925-8211-f6faea395e9c None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:05.657245 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71ab18-6213-4925-8211-f6faea395e9c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:05.657957 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71ab18-6213-4925-8211-f6faea395e9c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:05.659418 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71ab18-6213-4925-8211-f6faea395e9c None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:05.668297 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-7f71ab18-6213-4925-8211-f6faea395e9c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:07:05.668297 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:05.668297 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:07:05.668297 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:07:05.668297 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:07:05.668297 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:07:05.668297 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:07:05.668297 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:07:05.668297 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:07:05.668297 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:07:05.668297 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:07:05.668297 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:07:05.668297 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:05.668297 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:05.668297 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:05.668297 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:05.668297 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:05.669796 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:05.669796 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:05.669796 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:05.669796 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:05.669796 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:05.669796 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:05.669796 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:07:05.669796 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:07:05.669796 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:07:05.669796 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:07:05.669796 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:05.669796 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:05.669796 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:05.669796 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:05.669796 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:05.669796 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:05.671133 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:05.671133 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:05.671133 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:05.671133 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:05.671133 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:05.671133 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:05.671133 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:05.671133 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:05.671133 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:05.671133 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:05.671133 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:07:05.671133 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:07:05.671133 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:07:05.671133 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:07:05.671133 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 405/787] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 9 11:07:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:05.675619 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67866b-7f73-4dd0-b720-352f9338fbe2 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:05.702064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:05.775523 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67866b-7f73-4dd0-b720-352f9338fbe2 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:05.810793 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954441d-29e6-4679-926e-6c031c6c1e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:05.811421 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954441d-29e6-4679-926e-6c031c6c1e64 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:05.811689 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954441d-29e6-4679-926e-6c031c6c1e64 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:05.811961 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954441d-29e6-4679-926e-6c031c6c1e64 None admin] PATH_INFO: `/v3/services` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:05.812593 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954441d-29e6-4679-926e-6c031c6c1e64 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:05.812894 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954441d-29e6-4679-926e-6c031c6c1e64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:05.814333 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954441d-29e6-4679-926e-6c031c6c1e64 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:05.819448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 383/788] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 9 11:07:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:05.827275 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71ab18-6213-4925-8211-f6faea395e9c None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:05.840448 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:05.928990 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71ab18-6213-4925-8211-f6faea395e9c None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:05.962748 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958cfce-0f47-41a4-b9b4-1b5fde092f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:05.963348 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958cfce-0f47-41a4-b9b4-1b5fde092f34 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:05.963626 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958cfce-0f47-41a4-b9b4-1b5fde092f34 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:05.963894 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958cfce-0f47-41a4-b9b4-1b5fde092f34 None admin] PATH_INFO: `/v3/services` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:05.964572 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958cfce-0f47-41a4-b9b4-1b5fde092f34 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:05.964871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958cfce-0f47-41a4-b9b4-1b5fde092f34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:05.966249 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958cfce-0f47-41a4-b9b4-1b5fde092f34 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:05.971040 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 406/789] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 9 11:07:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:05.976753 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954441d-29e6-4679-926e-6c031c6c1e64 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:06.071821 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:06.082799 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954441d-29e6-4679-926e-6c031c6c1e64 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:06.116508 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b1d3c-3568-4c5e-8a3b-d4ea921dafbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:06.117112 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b1d3c-3568-4c5e-8a3b-d4ea921dafbc None admin] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:06.117407 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b1d3c-3568-4c5e-8a3b-d4ea921dafbc None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:06.117677 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b1d3c-3568-4c5e-8a3b-d4ea921dafbc None admin] PATH_INFO: `/v3/endpoints` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:06.118330 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b1d3c-3568-4c5e-8a3b-d4ea921dafbc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:06.119675 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b1d3c-3568-4c5e-8a3b-d4ea921dafbc None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:06.141026 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 384/790] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 9 11:07:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:07:06.970472 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205ceaf-290e-478a-af0b-f29d5399a642 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:06.971043 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205ceaf-290e-478a-af0b-f29d5399a642 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:06.971141 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205ceaf-290e-478a-af0b-f29d5399a642 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:06.972455 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 407/791] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:06.977758 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e95aa-b621-4579-a5f2-f0e123c7c9cb None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:06.978168 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e95aa-b621-4579-a5f2-f0e123c7c9cb None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:06.978317 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e95aa-b621-4579-a5f2-f0e123c7c9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:06.996794 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-a29e95aa-b621-4579-a5f2-f0e123c7c9cb None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:06.998009 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-a29e95aa-b621-4579-a5f2-f0e123c7c9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:07.069916 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 385/792] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:06 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:07:07.389965 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205ceaf-290e-478a-af0b-f29d5399a642 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:07.460839 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:07.493778 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205ceaf-290e-478a-af0b-f29d5399a642 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:07.527059 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d32f1-be4b-4ae7-ba17-2a31bd9843bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:07.527683 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d32f1-be4b-4ae7-ba17-2a31bd9843bc None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:07.527962 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d32f1-be4b-4ae7-ba17-2a31bd9843bc None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:07.528236 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d32f1-be4b-4ae7-ba17-2a31bd9843bc None admin] PATH_INFO: `/v3/services/compute` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:07.528820 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d32f1-be4b-4ae7-ba17-2a31bd9843bc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:07.530189 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d32f1-be4b-4ae7-ba17-2a31bd9843bc None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:07.538787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-5c0d32f1-be4b-4ae7-ba17-2a31bd9843bc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:07:07.538787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:07.538787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:07:07.538787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:07:07.538787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:07:07.538787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:07:07.538787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:07:07.538787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:07:07.538787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:07:07.538787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:07:07.538787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:07:07.538787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:07:07.538787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:07.538787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:07.538787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:07.538787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:07.538787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:07.539767 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:07.539767 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:07.539767 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:07.539767 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:07.539767 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:07.539767 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:07.539767 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:07:07.539767 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:07:07.539767 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:07:07.539767 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:07:07.539767 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:07.539767 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:07.539767 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:07.539767 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:07.539767 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:07.539767 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:07.540634 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:07.540634 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:07.540634 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:07.540634 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:07.540634 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:07.540634 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:07.540634 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:07.540634 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:07.540634 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:07.540634 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:07.540634 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:07:07.540634 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:07:07.540634 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:07:07.540634 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:07:07.540634 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 408/793] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:07:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:07:07.550344 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e95aa-b621-4579-a5f2-f0e123c7c9cb None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:07.619197 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:07.649586 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e95aa-b621-4579-a5f2-f0e123c7c9cb None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:07.682330 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe936de-5a58-4033-95d1-d12a89a86a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:07.683541 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe936de-5a58-4033-95d1-d12a89a86a24 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:07.683817 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe936de-5a58-4033-95d1-d12a89a86a24 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:07.684085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe936de-5a58-4033-95d1-d12a89a86a24 None admin] PATH_INFO: `/v3/services` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:07.684706 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe936de-5a58-4033-95d1-d12a89a86a24 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:07.684998 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe936de-5a58-4033-95d1-d12a89a86a24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:07.686380 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe936de-5a58-4033-95d1-d12a89a86a24 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:07.691361 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 386/794] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 9 11:07:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:07.696993 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d32f1-be4b-4ae7-ba17-2a31bd9843bc None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:07.793340 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d32f1-be4b-4ae7-ba17-2a31bd9843bc None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:07.828156 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fcd64-cc39-41a1-a908-b3652226e65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:07.828783 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fcd64-cc39-41a1-a908-b3652226e65f None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:07.829059 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fcd64-cc39-41a1-a908-b3652226e65f None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:07.829355 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fcd64-cc39-41a1-a908-b3652226e65f None admin] PATH_INFO: `/v3/services` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:07.829973 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fcd64-cc39-41a1-a908-b3652226e65f None admin] RBAC: Adding query filter params (type=compute) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:07.830268 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fcd64-cc39-41a1-a908-b3652226e65f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:07.831688 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fcd64-cc39-41a1-a908-b3652226e65f None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:07.833693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:07.841365 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 409/795] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 9 11:07:07 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:07:08.596588 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42b309-69fe-417e-b0f5-e1fb25760fa0 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:08.597093 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42b309-69fe-417e-b0f5-e1fb25760fa0 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:08.597093 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42b309-69fe-417e-b0f5-e1fb25760fa0 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:08.598432 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 387/796] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:08.603722 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305a05f-9498-427e-9899-9aa3c8893bff None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:08.604159 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305a05f-9498-427e-9899-9aa3c8893bff None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:08.604256 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305a05f-9498-427e-9899-9aa3c8893bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:08.622405 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-d305a05f-9498-427e-9899-9aa3c8893bff None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:08.623596 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-d305a05f-9498-427e-9899-9aa3c8893bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:08.688790 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 410/797] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:08 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:07:09.007876 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42b309-69fe-417e-b0f5-e1fb25760fa0 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:09.109675 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42b309-69fe-417e-b0f5-e1fb25760fa0 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:09.143325 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1139bf3-44db-4798-824d-a6eee87a40d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:09.143937 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1139bf3-44db-4798-824d-a6eee87a40d4 None admin] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:09.144217 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1139bf3-44db-4798-824d-a6eee87a40d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:09.144487 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1139bf3-44db-4798-824d-a6eee87a40d4 None admin] PATH_INFO: `/v3/projects` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:09.145127 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1139bf3-44db-4798-824d-a6eee87a40d4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:09.146776 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1139bf3-44db-4798-824d-a6eee87a40d4 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:09.149437 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: WARNING keystone.server.flask.common [None req-b1139bf3-44db-4798-824d-a6eee87a40d4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 09 11:07:09.154173 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:09.168297 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.sql.core [None req-b1139bf3-44db-4798-824d-a6eee87a40d4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 11:07:09.168297 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 09 11:07:09.168297 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [parameters: {'id': '8d34d9a6084140f5a89b43c6f7412b2d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 09 11:07:09.168297 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88463) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 09 11:07:09.185369 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-b1139bf3-44db-4798-824d-a6eee87a40d4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8d34d9a6084140f5a89b43c6f7412b2d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8d34d9a6084140f5a89b43c6f7412b2d. Sep 09 11:07:09.185369 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:09.185369 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 11:07:09.185369 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 11:07:09.185369 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 11:07:09.185369 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 11:07:09.185369 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 11:07:09.185369 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 11:07:09.185369 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 11:07:09.185369 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application conn.query(q) Sep 09 11:07:09.185369 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 11:07:09.185369 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 11:07:09.185369 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 11:07:09.186306 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application result.read() Sep 09 11:07:09.186306 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 11:07:09.186306 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 11:07:09.186306 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 11:07:09.186306 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 11:07:09.186306 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 11:07:09.186306 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 11:07:09.186306 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 11:07:09.186306 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 11:07:09.186306 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 11:07:09.186306 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:07:09.186306 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 09 11:07:09.186306 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:07:09.186306 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:09.186306 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 09 11:07:09.186306 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 09 11:07:09.186306 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 09 11:07:09.186306 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 09 11:07:09.192444 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 11:07:09.192444 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application next(self.gen) Sep 09 11:07:09.192444 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 09 11:07:09.192444 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application yield resource Sep 09 11:07:09.192444 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 11:07:09.192444 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application next(self.gen) Sep 09 11:07:09.192444 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 09 11:07:09.192444 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self.session.rollback() Sep 09 11:07:09.192444 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 09 11:07:09.192444 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self.force_reraise() Sep 09 11:07:09.192444 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 09 11:07:09.192444 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise self.value Sep 09 11:07:09.192444 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 09 11:07:09.192444 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 09 11:07:09.192444 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 09 11:07:09.192444 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application session.commit() Sep 09 11:07:09.192444 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 09 11:07:09.193428 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 09 11:07:09.193428 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 09 11:07:09.193428 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self._prepare_impl() Sep 09 11:07:09.193428 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 09 11:07:09.193428 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self.session.flush() Sep 09 11:07:09.193428 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 09 11:07:09.193428 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self._flush(objects) Sep 09 11:07:09.193428 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 09 11:07:09.193428 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 09 11:07:09.193428 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 09 11:07:09.193428 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application compat.raise_( Sep 09 11:07:09.193428 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 11:07:09.193428 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception Sep 09 11:07:09.193428 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 09 11:07:09.193428 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application flush_context.execute() Sep 09 11:07:09.193428 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 09 11:07:09.193428 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rec.execute(self) Sep 09 11:07:09.194346 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 09 11:07:09.194346 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 09 11:07:09.194346 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 09 11:07:09.194346 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 09 11:07:09.194346 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 09 11:07:09.194346 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 09 11:07:09.194346 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 09 11:07:09.194346 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 09 11:07:09.194346 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 09 11:07:09.194346 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 09 11:07:09.194346 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 09 11:07:09.194346 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 09 11:07:09.194346 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 09 11:07:09.194346 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 09 11:07:09.194346 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 09 11:07:09.195215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 09 11:07:09.195215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 11:07:09.195215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception Sep 09 11:07:09.195215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 11:07:09.195215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 11:07:09.195215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 11:07:09.195215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 11:07:09.195215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 11:07:09.195215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 11:07:09.195215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 11:07:09.195215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application conn.query(q) Sep 09 11:07:09.195215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 11:07:09.195215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 11:07:09.195215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 11:07:09.195215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application result.read() Sep 09 11:07:09.195215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 11:07:09.195215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 11:07:09.196118 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 11:07:09.196118 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 11:07:09.196118 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 11:07:09.196118 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 11:07:09.196118 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 11:07:09.196118 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 11:07:09.196118 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 11:07:09.196118 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 09 11:07:09.196118 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [parameters: {'id': '8d34d9a6084140f5a89b43c6f7412b2d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 09 11:07:09.196118 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 09 11:07:09.196118 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:07:09.196118 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:07:09.196118 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:07:09.196118 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:09.196118 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 09 11:07:09.196922 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 09 11:07:09.196922 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 09 11:07:09.196922 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 09 11:07:09.196922 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 09 11:07:09.196922 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:07:09.196922 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:07:09.196922 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:07:09.196922 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:09.196922 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:09.196922 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:09.196922 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:09.196922 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:09.196922 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:09.196922 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:09.196922 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:09.196922 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:09.196922 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:09.199830 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:09.199830 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 09 11:07:09.199830 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 09 11:07:09.199830 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:09.199830 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:09.199830 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 09 11:07:09.199830 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 09 11:07:09.199830 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8d34d9a6084140f5a89b43c6f7412b2d. Sep 09 11:07:09.199830 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:07:09.199830 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 388/798] 10.222.0.20 () {60 vars in 1140 bytes} [Fri Sep 9 11:07:09 2022] POST /identity/v3/projects => generated 262 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:09.201105 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305a05f-9498-427e-9899-9aa3c8893bff None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:09.296867 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305a05f-9498-427e-9899-9aa3c8893bff None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:09.328583 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:09.334837 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0967e84-e1a4-4e62-865a-2a6d71b2f35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:09.335469 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0967e84-e1a4-4e62-865a-2a6d71b2f35d None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:09.335748 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0967e84-e1a4-4e62-865a-2a6d71b2f35d None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:09.336020 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0967e84-e1a4-4e62-865a-2a6d71b2f35d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:09.343362 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0967e84-e1a4-4e62-865a-2a6d71b2f35d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:09.344780 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0967e84-e1a4-4e62-865a-2a6d71b2f35d None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:09.357901 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-a0967e84-e1a4-4e62-865a-2a6d71b2f35d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:07:09.357901 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:09.357901 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:09.357901 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:09.357901 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:09.357901 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:09.357901 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:09.357901 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:09.357901 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:09.357901 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:09.357901 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:09.357901 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:09.357901 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:07:09.357901 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:07:09.357901 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:07:09.358836 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:07:09.358836 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:09.358836 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:09.358836 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:09.358836 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:09.358836 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:09.358836 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:09.358836 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:09.358836 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:09.358836 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:09.358836 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:09.358836 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:09.358836 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:09.358836 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:09.358836 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:09.358836 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:09.358836 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:09.359853 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:07:09.359853 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:07:09.359853 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:07:09.359853 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:07:09.359853 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:07:09.359853 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:07:09.359853 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:07:09.359853 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:07:09.359853 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 411/799] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:07:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:09.365275 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1139bf3-44db-4798-824d-a6eee87a40d4 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:09.464910 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1139bf3-44db-4798-824d-a6eee87a40d4 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:09.498459 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b79db-e608-49a6-9863-b6d8c989bfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:09.499066 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b79db-e608-49a6-9863-b6d8c989bfa1 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:09.499340 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b79db-e608-49a6-9863-b6d8c989bfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:09.499606 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b79db-e608-49a6-9863-b6d8c989bfa1 None admin] PATH_INFO: `/v3/projects` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:09.500259 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b79db-e608-49a6-9863-b6d8c989bfa1 None admin] RBAC: Adding query filter params (name=service) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:09.500558 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b79db-e608-49a6-9863-b6d8c989bfa1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:09.502230 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b79db-e608-49a6-9863-b6d8c989bfa1 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:09.524411 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 389/800] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 9 11:07:09 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:10.314317 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120566d9-77ec-4349-a1b7-62da13b15d80 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:10.314861 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120566d9-77ec-4349-a1b7-62da13b15d80 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:10.314861 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120566d9-77ec-4349-a1b7-62da13b15d80 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:10.316227 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 412/801] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:10.321611 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcddc81-b1dc-40e0-b525-2bc922163725 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:10.322019 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcddc81-b1dc-40e0-b525-2bc922163725 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:10.322160 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcddc81-b1dc-40e0-b525-2bc922163725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:10.462226 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-1dcddc81-b1dc-40e0-b525-2bc922163725 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:10.463762 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-1dcddc81-b1dc-40e0-b525-2bc922163725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:10.511482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:10.539825 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 390/802] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:10 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:07:10.865104 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120566d9-77ec-4349-a1b7-62da13b15d80 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:10.969390 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120566d9-77ec-4349-a1b7-62da13b15d80 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:11.002527 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc2f5e-5b3e-4c99-8476-ddc39cd2f1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:11.003135 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc2f5e-5b3e-4c99-8476-ddc39cd2f1bb None admin] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:11.003415 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc2f5e-5b3e-4c99-8476-ddc39cd2f1bb None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:11.003691 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc2f5e-5b3e-4c99-8476-ddc39cd2f1bb None admin] PATH_INFO: `/v3/services` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:11.004350 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc2f5e-5b3e-4c99-8476-ddc39cd2f1bb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:11.005742 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc2f5e-5b3e-4c99-8476-ddc39cd2f1bb None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:11.021782 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 413/803] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 9 11:07:10 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:07:11.988123 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e1a20-7c61-4a2e-90db-c296eb3e17ae None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:11.988664 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e1a20-7c61-4a2e-90db-c296eb3e17ae None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:11.988664 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e1a20-7c61-4a2e-90db-c296eb3e17ae None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:11.990128 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 391/804] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:11.995560 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12fdd9-fc83-4fd7-8524-062112727d16 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:11.996008 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12fdd9-fc83-4fd7-8524-062112727d16 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:11.996099 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12fdd9-fc83-4fd7-8524-062112727d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:12.014529 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-be12fdd9-fc83-4fd7-8524-062112727d16 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:12.015730 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-be12fdd9-fc83-4fd7-8524-062112727d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:12.063569 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:12.092456 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 414/805] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:11 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:07:12.432840 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e1a20-7c61-4a2e-90db-c296eb3e17ae None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:12.534924 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e1a20-7c61-4a2e-90db-c296eb3e17ae None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:12.568372 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93844f19-45d5-4865-b5cc-db9c00f5e3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:12.568908 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93844f19-45d5-4865-b5cc-db9c00f5e3c8 None admin] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:12.569185 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93844f19-45d5-4865-b5cc-db9c00f5e3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:12.569481 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93844f19-45d5-4865-b5cc-db9c00f5e3c8 None admin] PATH_INFO: `/v3/users` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:12.570115 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93844f19-45d5-4865-b5cc-db9c00f5e3c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:12.571563 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93844f19-45d5-4865-b5cc-db9c00f5e3c8 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:12.587755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.sql.core [None req-93844f19-45d5-4865-b5cc-db9c00f5e3c8 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 11:07:12.587755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 09 11:07:12.587755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [parameters: {'user_id': 'b80fc9cc4595432c8d80ff60d33fffd0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 09 11:07:12.587755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88463) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 09 11:07:12.595339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-93844f19-45d5-4865-b5cc-db9c00f5e3c8 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 09 11:07:12.595339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:12.595339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 11:07:12.595339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 11:07:12.595339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 11:07:12.595339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 11:07:12.595339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 11:07:12.595339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 11:07:12.595339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 11:07:12.595339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application conn.query(q) Sep 09 11:07:12.595339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 11:07:12.595339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 11:07:12.595339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 11:07:12.595339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application result.read() Sep 09 11:07:12.595339 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 11:07:12.596269 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 11:07:12.596269 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 11:07:12.596269 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 11:07:12.596269 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 11:07:12.596269 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 11:07:12.596269 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 11:07:12.596269 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 11:07:12.596269 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 11:07:12.596269 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:07:12.596269 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 09 11:07:12.596269 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:07:12.596269 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:12.596269 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 09 11:07:12.596269 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 09 11:07:12.596269 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 09 11:07:12.596269 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 09 11:07:12.596269 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 11:07:12.596269 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application next(self.gen) Sep 09 11:07:12.597215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 09 11:07:12.597215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application yield resource Sep 09 11:07:12.597215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 11:07:12.597215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application next(self.gen) Sep 09 11:07:12.597215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 09 11:07:12.597215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self.session.rollback() Sep 09 11:07:12.597215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 09 11:07:12.597215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self.force_reraise() Sep 09 11:07:12.597215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 09 11:07:12.597215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise self.value Sep 09 11:07:12.597215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 09 11:07:12.597215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 09 11:07:12.597215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 09 11:07:12.597215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application session.commit() Sep 09 11:07:12.597215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 09 11:07:12.597215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 09 11:07:12.597215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 09 11:07:12.598163 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self._prepare_impl() Sep 09 11:07:12.598163 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 09 11:07:12.598163 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self.session.flush() Sep 09 11:07:12.598163 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 09 11:07:12.598163 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self._flush(objects) Sep 09 11:07:12.598163 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 09 11:07:12.598163 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 09 11:07:12.598163 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 09 11:07:12.598163 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application compat.raise_( Sep 09 11:07:12.598163 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 11:07:12.598163 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception Sep 09 11:07:12.598163 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 09 11:07:12.598163 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application flush_context.execute() Sep 09 11:07:12.598163 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 09 11:07:12.598163 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rec.execute(self) Sep 09 11:07:12.598163 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 09 11:07:12.598163 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 09 11:07:12.599056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 09 11:07:12.599056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 09 11:07:12.599056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 09 11:07:12.599056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 09 11:07:12.599056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 09 11:07:12.599056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 09 11:07:12.599056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 09 11:07:12.599056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 09 11:07:12.599056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 09 11:07:12.599056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 09 11:07:12.599056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 09 11:07:12.599056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 09 11:07:12.599056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 09 11:07:12.599056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 09 11:07:12.599056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 11:07:12.599056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception Sep 09 11:07:12.600065 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 11:07:12.600065 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 11:07:12.600065 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 11:07:12.600065 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 11:07:12.600065 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 11:07:12.600065 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 11:07:12.600065 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 11:07:12.600065 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application conn.query(q) Sep 09 11:07:12.600065 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 11:07:12.600065 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 11:07:12.600065 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 11:07:12.600065 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application result.read() Sep 09 11:07:12.600065 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 11:07:12.600065 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 11:07:12.600065 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 11:07:12.600065 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 11:07:12.601192 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 11:07:12.601192 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 11:07:12.601192 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 11:07:12.601192 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 11:07:12.601192 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 11:07:12.601192 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 09 11:07:12.601192 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b80fc9cc4595432c8d80ff60d33fffd0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 09 11:07:12.601192 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 09 11:07:12.601192 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:07:12.601192 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:07:12.601192 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:07:12.601192 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:12.601192 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:12.601192 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:12.601192 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:12.602864 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:12.602864 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:12.602864 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:12.602864 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:12.602864 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:12.602864 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:12.602864 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:12.602864 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 09 11:07:12.602864 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 09 11:07:12.602864 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:12.602864 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:12.602864 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:07:12.602864 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:07:12.602864 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:07:12.602864 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:07:12.602864 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 09 11:07:12.602864 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 09 11:07:12.605009 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 09 11:07:12.605009 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 09 11:07:12.605009 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 09 11:07:12.605009 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 09 11:07:12.605009 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 09 11:07:12.605009 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:07:12.605009 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 392/806] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Sep 9 11:07:12 2022] POST /identity/v3/users => generated 160 bytes in 164 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:12.605911 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12fdd9-fc83-4fd7-8524-062112727d16 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:12.702663 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12fdd9-fc83-4fd7-8524-062112727d16 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:12.736085 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda0e09-809b-494f-9ef7-6ca183f7a5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:12.736722 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda0e09-809b-494f-9ef7-6ca183f7a5bf None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:12.737001 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda0e09-809b-494f-9ef7-6ca183f7a5bf None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:12.737272 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda0e09-809b-494f-9ef7-6ca183f7a5bf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:12.745790 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda0e09-809b-494f-9ef7-6ca183f7a5bf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:12.747234 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda0e09-809b-494f-9ef7-6ca183f7a5bf None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:12.758969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-0bda0e09-809b-494f-9ef7-6ca183f7a5bf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:07:12.758969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:12.758969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:12.758969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:12.758969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:12.758969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:12.758969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:12.758969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:12.758969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:12.758969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:12.758969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:12.758969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:12.758969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:07:12.758969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:07:12.758969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:07:12.758969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:07:12.759953 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:12.759953 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:12.759953 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:07:12.759953 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:07:12.759953 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:07:12.759953 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:07:12.759953 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:12.759953 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:12.759953 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:12.759953 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:12.759953 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:12.759953 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:12.759953 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:12.759953 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:12.759953 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:12.759953 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:12.759953 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:12.759953 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:12.761622 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:12.761622 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:12.761622 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:07:12.761622 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:07:12.761622 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:07:12.761622 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:07:12.761622 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:07:12.761622 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:07:12.761622 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:07:12.761622 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:07:12.761622 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 415/807] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:07:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:12.766713 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93844f19-45d5-4865-b5cc-db9c00f5e3c8 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:12.814999 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:12.870535 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93844f19-45d5-4865-b5cc-db9c00f5e3c8 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:12.904972 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605c920-a54f-4b5d-9c60-73569415f6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:12.905629 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605c920-a54f-4b5d-9c60-73569415f6df None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:12.905908 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605c920-a54f-4b5d-9c60-73569415f6df None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:12.906180 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605c920-a54f-4b5d-9c60-73569415f6df None admin] PATH_INFO: `/v3/users` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:12.906906 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605c920-a54f-4b5d-9c60-73569415f6df None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:12.907205 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605c920-a54f-4b5d-9c60-73569415f6df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:12.908862 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605c920-a54f-4b5d-9c60-73569415f6df None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:12.949172 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 393/808] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 9 11:07:12 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:13.477398 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddb94d-a916-4325-9145-2d1149f8bf07 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:13.477921 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddb94d-a916-4325-9145-2d1149f8bf07 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:13.477921 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddb94d-a916-4325-9145-2d1149f8bf07 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:13.479273 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 416/809] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:13.485268 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d695a7-816e-4616-9e10-7099f48a673b None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:13.485718 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d695a7-816e-4616-9e10-7099f48a673b None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:13.485826 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d695a7-816e-4616-9e10-7099f48a673b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:13.505488 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-35d695a7-816e-4616-9e10-7099f48a673b None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:13.507008 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-35d695a7-816e-4616-9e10-7099f48a673b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:13.584233 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 394/810] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:13 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:07:13.911905 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddb94d-a916-4325-9145-2d1149f8bf07 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:13.948446 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:14.013123 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddb94d-a916-4325-9145-2d1149f8bf07 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:14.047670 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e646da-ff59-4932-a0e0-b57f701267f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:14.048376 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e646da-ff59-4932-a0e0-b57f701267f5 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:14.048663 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e646da-ff59-4932-a0e0-b57f701267f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:14.048937 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e646da-ff59-4932-a0e0-b57f701267f5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:14.049559 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e646da-ff59-4932-a0e0-b57f701267f5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:14.050948 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e646da-ff59-4932-a0e0-b57f701267f5 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:14.060982 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-45e646da-ff59-4932-a0e0-b57f701267f5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:07:14.060982 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:14.060982 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:07:14.060982 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:07:14.060982 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:07:14.060982 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:07:14.060982 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:07:14.060982 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:07:14.060982 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:07:14.060982 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:07:14.060982 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:07:14.060982 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:07:14.060982 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:14.060982 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:14.060982 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:14.060982 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:14.060982 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:14.062240 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:14.062240 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:14.062240 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:14.062240 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:14.062240 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:14.062240 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:14.062240 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:07:14.062240 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:07:14.062240 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:07:14.062240 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:07:14.062240 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:14.062240 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:14.062240 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:14.062240 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:14.062240 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:14.062240 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:14.063101 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:14.063101 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:14.063101 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:14.063101 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:14.063101 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:14.063101 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:14.063101 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:14.063101 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:14.063101 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:14.063101 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:14.063101 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:07:14.063101 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:07:14.063101 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:07:14.063101 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:07:14.063101 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 417/811] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:07:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:14.068304 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d695a7-816e-4616-9e10-7099f48a673b None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:14.097665 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:14.164963 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d695a7-816e-4616-9e10-7099f48a673b None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:14.198552 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459ca1d-f1f2-490a-812e-f7ec16146bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:14.199153 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459ca1d-f1f2-490a-812e-f7ec16146bc5 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:14.199430 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459ca1d-f1f2-490a-812e-f7ec16146bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:14.199697 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459ca1d-f1f2-490a-812e-f7ec16146bc5 None admin] PATH_INFO: `/v3/services` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:14.200346 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459ca1d-f1f2-490a-812e-f7ec16146bc5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:14.200617 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459ca1d-f1f2-490a-812e-f7ec16146bc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:14.202004 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459ca1d-f1f2-490a-812e-f7ec16146bc5 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:14.206818 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 395/812] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 9 11:07:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:14.213062 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e646da-ff59-4932-a0e0-b57f701267f5 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:14.316741 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:14.319967 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e646da-ff59-4932-a0e0-b57f701267f5 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:14.355045 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48e2cc-80c6-4049-9de1-a0f9bcf288c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:14.355691 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48e2cc-80c6-4049-9de1-a0f9bcf288c6 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:14.355965 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48e2cc-80c6-4049-9de1-a0f9bcf288c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:14.356233 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48e2cc-80c6-4049-9de1-a0f9bcf288c6 None admin] PATH_INFO: `/v3/services` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:14.356845 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d48e2cc-80c6-4049-9de1-a0f9bcf288c6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:14.357137 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d48e2cc-80c6-4049-9de1-a0f9bcf288c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:14.358523 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d48e2cc-80c6-4049-9de1-a0f9bcf288c6 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:14.363108 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 418/813] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 9 11:07:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:14.369049 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459ca1d-f1f2-490a-812e-f7ec16146bc5 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:14.459535 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:14.465901 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459ca1d-f1f2-490a-812e-f7ec16146bc5 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:14.499234 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3a557-11ab-49b0-9e63-203c990e34f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:14.499847 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3a557-11ab-49b0-9e63-203c990e34f6 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:14.500095 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3a557-11ab-49b0-9e63-203c990e34f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:14.500363 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3a557-11ab-49b0-9e63-203c990e34f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:14.501049 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3a557-11ab-49b0-9e63-203c990e34f6 None admin] RBAC: Adding query filter params (interface=public, service_id=1484f27e52574338b14f21e15e720dc9, region_id=RegionOne) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:14.501382 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3a557-11ab-49b0-9e63-203c990e34f6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:14.502729 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3a557-11ab-49b0-9e63-203c990e34f6 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:14.507554 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 396/814] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Sep 9 11:07:14 2022] GET /identity/v3/endpoints?service_id=1484f27e52574338b14f21e15e720dc9&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:14.513351 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48e2cc-80c6-4049-9de1-a0f9bcf288c6 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:14.609635 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48e2cc-80c6-4049-9de1-a0f9bcf288c6 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:14.644596 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f3e1f-3289-4d30-869d-c102cbf1105e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:14.645194 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f3e1f-3289-4d30-869d-c102cbf1105e None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:14.645500 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f3e1f-3289-4d30-869d-c102cbf1105e None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:14.645772 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f3e1f-3289-4d30-869d-c102cbf1105e None admin] PATH_INFO: `/v3/services` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:14.646371 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f3e1f-3289-4d30-869d-c102cbf1105e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:14.647720 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f3e1f-3289-4d30-869d-c102cbf1105e None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:14.654521 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 419/815] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 9 11:07:14 2022] GET /identity/v3/services => generated 1728 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:07:17.067787 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9931c-cbbb-4e93-88d1-c093f6dbe6d7 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:17.068391 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9931c-cbbb-4e93-88d1-c093f6dbe6d7 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:17.068391 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9931c-cbbb-4e93-88d1-c093f6dbe6d7 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:17.069691 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 397/816] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:17.074846 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4794a06-a474-4da3-a9d2-fc0d3fee6289 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:17.075231 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4794a06-a474-4da3-a9d2-fc0d3fee6289 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:17.075398 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4794a06-a474-4da3-a9d2-fc0d3fee6289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:17.093268 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-b4794a06-a474-4da3-a9d2-fc0d3fee6289 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:17.094475 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-b4794a06-a474-4da3-a9d2-fc0d3fee6289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:17.116729 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:17.159786 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 420/817] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:17 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:07:17.485891 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9931c-cbbb-4e93-88d1-c093f6dbe6d7 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:17.587343 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9931c-cbbb-4e93-88d1-c093f6dbe6d7 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:17.620696 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05edbb-541e-44e3-819e-d85f5f681f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:17.621345 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05edbb-541e-44e3-819e-d85f5f681f65 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:17.621623 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05edbb-541e-44e3-819e-d85f5f681f65 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:17.621888 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05edbb-541e-44e3-819e-d85f5f681f65 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:17.622456 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05edbb-541e-44e3-819e-d85f5f681f65 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:17.623799 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05edbb-541e-44e3-819e-d85f5f681f65 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:17.632213 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-7a05edbb-541e-44e3-819e-d85f5f681f65 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:07:17.632213 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:17.632213 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:07:17.632213 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:07:17.632213 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:07:17.632213 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:07:17.632213 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:07:17.632213 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:07:17.632213 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:07:17.632213 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:07:17.632213 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:07:17.632213 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:07:17.632213 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:17.632213 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:17.632213 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:17.632213 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:17.632213 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:17.633402 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:17.633402 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:17.633402 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:17.633402 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:17.633402 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:17.633402 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:17.633402 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:07:17.633402 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:07:17.633402 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:07:17.633402 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:07:17.633402 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:17.633402 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:17.633402 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:17.633402 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:17.633402 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:17.633402 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:17.634451 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:17.634451 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:17.634451 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:17.634451 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:17.634451 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:17.634451 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:17.634451 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:17.634451 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:17.634451 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:17.634451 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:17.634451 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:07:17.634451 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:07:17.634451 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:07:17.634451 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:07:17.637456 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 398/818] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:07:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:17.639669 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4794a06-a474-4da3-a9d2-fc0d3fee6289 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:17.738373 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4794a06-a474-4da3-a9d2-fc0d3fee6289 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:17.771919 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a468b4-4f4e-4ed7-bd7a-2c8379672969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:17.772520 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a468b4-4f4e-4ed7-bd7a-2c8379672969 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:17.772798 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a468b4-4f4e-4ed7-bd7a-2c8379672969 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:17.773068 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a468b4-4f4e-4ed7-bd7a-2c8379672969 None admin] PATH_INFO: `/v3/services` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:17.773721 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a468b4-4f4e-4ed7-bd7a-2c8379672969 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:17.774021 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a468b4-4f4e-4ed7-bd7a-2c8379672969 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:17.775367 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a468b4-4f4e-4ed7-bd7a-2c8379672969 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:17.780668 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 421/819] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 9 11:07:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:17.786497 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05edbb-541e-44e3-819e-d85f5f681f65 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:17.811998 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:17.886047 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05edbb-541e-44e3-819e-d85f5f681f65 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:17.921946 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc980c-16e4-42bd-bfeb-64edefe8025e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:17.922556 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc980c-16e4-42bd-bfeb-64edefe8025e None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:17.922834 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc980c-16e4-42bd-bfeb-64edefe8025e None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:17.923104 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc980c-16e4-42bd-bfeb-64edefe8025e None admin] PATH_INFO: `/v3/services` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:17.923736 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc980c-16e4-42bd-bfeb-64edefe8025e None admin] RBAC: Adding query filter params (type=compute) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:17.924036 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc980c-16e4-42bd-bfeb-64edefe8025e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:17.925427 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc980c-16e4-42bd-bfeb-64edefe8025e None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:17.930776 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 399/820] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 9 11:07:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:17.937256 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a468b4-4f4e-4ed7-bd7a-2c8379672969 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:17.962850 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:18.039739 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a468b4-4f4e-4ed7-bd7a-2c8379672969 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:18.072911 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e98bc-a7d2-4c59-997b-ae46c90dafaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:18.074180 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e98bc-a7d2-4c59-997b-ae46c90dafaa None admin] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:18.074458 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e98bc-a7d2-4c59-997b-ae46c90dafaa None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:18.074726 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e98bc-a7d2-4c59-997b-ae46c90dafaa None admin] PATH_INFO: `/v3/endpoints` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:18.075405 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e98bc-a7d2-4c59-997b-ae46c90dafaa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:18.076772 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e98bc-a7d2-4c59-997b-ae46c90dafaa None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:18.097272 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 422/821] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 9 11:07:17 2022] POST /identity/v3/endpoints => generated 334 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:07:27.928002 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=56 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:28.092991 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=60,keystone:INSERT=1 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:22.598176 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9d962-4293-490f-8133-450bee37a543 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:22.598956 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9d962-4293-490f-8133-450bee37a543 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:22.598956 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9d962-4293-490f-8133-450bee37a543 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:22.600123 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 400/822] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:22.606729 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022ccf1-31d8-4ae3-a7a0-41a23fa40516 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:22.607377 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022ccf1-31d8-4ae3-a7a0-41a23fa40516 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:22.607377 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022ccf1-31d8-4ae3-a7a0-41a23fa40516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:22.629592 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-a022ccf1-31d8-4ae3-a7a0-41a23fa40516 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:22.630771 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-a022ccf1-31d8-4ae3-a7a0-41a23fa40516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:22.750088 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 423/823] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:22 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:08:23.097980 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9d962-4293-490f-8133-450bee37a543 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:23.256918 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9d962-4293-490f-8133-450bee37a543 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:23.313324 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe8257-5e3c-411b-a523-a5986e22150a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:23.314155 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe8257-5e3c-411b-a523-a5986e22150a None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:23.314499 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe8257-5e3c-411b-a523-a5986e22150a None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:23.314820 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe8257-5e3c-411b-a523-a5986e22150a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:23.333487 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe8257-5e3c-411b-a523-a5986e22150a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:23.335451 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe8257-5e3c-411b-a523-a5986e22150a None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:23.353526 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-63fe8257-5e3c-411b-a523-a5986e22150a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:23.353526 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:23.353526 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:23.353526 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:23.353526 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:23.353526 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:23.353526 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:23.353526 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:23.353526 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:23.353526 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:23.353526 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:23.353526 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:23.353526 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:23.353526 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:23.353526 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:23.353526 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:23.354575 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:23.354575 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:23.354575 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:23.354575 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:23.354575 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:23.354575 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:23.354575 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:23.354575 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:23.354575 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:23.354575 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:23.354575 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:23.354575 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:23.354575 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:23.354575 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:23.354575 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:23.354575 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:23.354575 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:23.355550 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:23.355550 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:23.355550 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:08:23.357454 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 401/824] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:23.365028 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022ccf1-31d8-4ae3-a7a0-41a23fa40516 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:23.521222 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022ccf1-31d8-4ae3-a7a0-41a23fa40516 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:23.568996 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:23.585914 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f95a9-5803-4e5b-90de-843fc2f43188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:23.587604 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f95a9-5803-4e5b-90de-843fc2f43188 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:23.588138 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f95a9-5803-4e5b-90de-843fc2f43188 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:23.588744 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f95a9-5803-4e5b-90de-843fc2f43188 None admin] PATH_INFO: `/v3/domains` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:23.589713 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f95a9-5803-4e5b-90de-843fc2f43188 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:23.590267 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f95a9-5803-4e5b-90de-843fc2f43188 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:23.592879 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f95a9-5803-4e5b-90de-843fc2f43188 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:23.621377 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 424/825] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:23.622110 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe8257-5e3c-411b-a523-a5986e22150a None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:23.710572 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:23.780788 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe8257-5e3c-411b-a523-a5986e22150a None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:23.826631 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b822f36-6408-4000-a402-34bae99d9d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:23.827252 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b822f36-6408-4000-a402-34bae99d9d24 None admin] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:23.827551 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b822f36-6408-4000-a402-34bae99d9d24 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:23.827874 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b822f36-6408-4000-a402-34bae99d9d24 None admin] PATH_INFO: `/v3/users` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:23.828577 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b822f36-6408-4000-a402-34bae99d9d24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:23.830096 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b822f36-6408-4000-a402-34bae99d9d24 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:23.860409 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 402/826] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 9 11:08:23 2022] POST /identity/v3/users => generated 251 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:08:26.735718 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe1668-cca5-4de1-86ac-dce2ad60e61e None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:26.736293 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe1668-cca5-4de1-86ac-dce2ad60e61e None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:26.736592 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe1668-cca5-4de1-86ac-dce2ad60e61e None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:26.741400 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 425/827] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:08:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:26.744939 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c498e-608c-4cc7-9802-1a6dde08bbb1 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:26.745511 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c498e-608c-4cc7-9802-1a6dde08bbb1 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:26.745511 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c498e-608c-4cc7-9802-1a6dde08bbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:26.766966 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-f44c498e-608c-4cc7-9802-1a6dde08bbb1 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:26.768214 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-f44c498e-608c-4cc7-9802-1a6dde08bbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:26.897335 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 403/828] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:26 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:08:27.272179 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe1668-cca5-4de1-86ac-dce2ad60e61e None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:27.430507 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe1668-cca5-4de1-86ac-dce2ad60e61e None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:27.475244 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012420b7-b70d-4701-a172-99b4931c769f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:27.476291 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012420b7-b70d-4701-a172-99b4931c769f None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:27.476714 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012420b7-b70d-4701-a172-99b4931c769f None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:27.477054 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012420b7-b70d-4701-a172-99b4931c769f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:27.496021 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012420b7-b70d-4701-a172-99b4931c769f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:27.502829 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-012420b7-b70d-4701-a172-99b4931c769f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:08:27.502829 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:27.502829 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:27.502829 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:27.502829 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:27.502829 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:27.502829 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:27.502829 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:27.502829 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:27.502829 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:27.502829 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:27.502829 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:27.502829 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:27.502829 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:27.502829 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:27.502829 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:27.504368 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:27.504368 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:27.504368 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:27.504368 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:27.504368 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:27.504368 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:27.504368 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:27.504368 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:27.504368 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:27.504368 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:27.504368 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:27.504368 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:27.504368 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:27.504368 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:27.504368 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:27.504368 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:27.505524 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:27.505524 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:27.505524 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:27.505524 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:27.505524 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:27.505524 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:27.505524 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:27.505524 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:27.505524 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:27.505524 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:27.505524 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:08:27.505524 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:08:27.513343 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 426/829] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 9 11:08:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:27.513594 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c498e-608c-4cc7-9802-1a6dde08bbb1 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:27.566649 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:27.644649 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c498e-608c-4cc7-9802-1a6dde08bbb1 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:27.694805 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17dd80-77a8-406c-949f-8688e5ec9500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:27.695676 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17dd80-77a8-406c-949f-8688e5ec9500 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:27.696090 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17dd80-77a8-406c-949f-8688e5ec9500 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:27.697190 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17dd80-77a8-406c-949f-8688e5ec9500 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:27.698104 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17dd80-77a8-406c-949f-8688e5ec9500 None admin] RBAC: Adding query filter params (name=service) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:27.698660 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17dd80-77a8-406c-949f-8688e5ec9500 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:27.701064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17dd80-77a8-406c-949f-8688e5ec9500 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:27.714686 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 404/830] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 9 11:08:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:27.722164 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012420b7-b70d-4701-a172-99b4931c769f None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:27.784076 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:27.853122 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012420b7-b70d-4701-a172-99b4931c769f None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:27.898516 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4caa3d9-ecbe-4f9b-84b4-78f84aa5660d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:27.899361 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caa3d9-ecbe-4f9b-84b4-78f84aa5660d None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:27.899575 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caa3d9-ecbe-4f9b-84b4-78f84aa5660d None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:27.899883 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caa3d9-ecbe-4f9b-84b4-78f84aa5660d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:27.913771 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4caa3d9-ecbe-4f9b-84b4-78f84aa5660d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:27.915375 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4caa3d9-ecbe-4f9b-84b4-78f84aa5660d None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:27.936736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-f4caa3d9-ecbe-4f9b-84b4-78f84aa5660d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:27.936736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:27.936736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:27.936736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:27.936736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:27.936736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:27.936736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:27.936736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:27.936736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:27.936736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:27.936736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:27.936736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:27.936736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:27.936736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:27.936736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:27.936736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:27.939340 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:27.939340 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:27.939340 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:27.939340 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:27.939340 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:27.939340 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:27.939340 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:27.939340 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:27.939340 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:27.939340 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:27.939340 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:27.939340 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:27.939340 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:27.939340 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:27.939340 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:27.939340 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:27.939340 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:27.940470 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:27.940470 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:27.940470 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:08:27.940470 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 427/831] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:27.945639 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17dd80-77a8-406c-949f-8688e5ec9500 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:28.075409 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:28.079663 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17dd80-77a8-406c-949f-8688e5ec9500 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:28.124628 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6258e7d-7d52-4810-ae47-b645c05b605e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:28.125168 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6258e7d-7d52-4810-ae47-b645c05b605e None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:28.125511 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6258e7d-7d52-4810-ae47-b645c05b605e None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:28.125785 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6258e7d-7d52-4810-ae47-b645c05b605e None admin] PATH_INFO: `/v3/domains` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:28.126435 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6258e7d-7d52-4810-ae47-b645c05b605e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:28.126740 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6258e7d-7d52-4810-ae47-b645c05b605e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:28.128183 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6258e7d-7d52-4810-ae47-b645c05b605e None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:28.141040 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 405/832] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:28.147049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4caa3d9-ecbe-4f9b-84b4-78f84aa5660d None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:28.269088 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:28.275033 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4caa3d9-ecbe-4f9b-84b4-78f84aa5660d None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:28.331704 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58471972-2563-4180-a2d2-55568860e204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:28.332538 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58471972-2563-4180-a2d2-55568860e204 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:28.333044 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58471972-2563-4180-a2d2-55568860e204 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:28.333537 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58471972-2563-4180-a2d2-55568860e204 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:28.343892 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58471972-2563-4180-a2d2-55568860e204 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:28.345800 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58471972-2563-4180-a2d2-55568860e204 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:28.363138 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-58471972-2563-4180-a2d2-55568860e204 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:08:28.363138 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:28.363138 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:28.363138 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:28.363138 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:28.363138 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:28.363138 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:28.363138 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:28.363138 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:28.363138 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:28.363138 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:28.363138 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:28.363138 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:08:28.363138 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:08:28.363138 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:08:28.363138 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:08:28.364204 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:28.364204 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:28.364204 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:08:28.364204 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:28.364204 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:08:28.364204 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:28.364204 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:28.364204 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:28.364204 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:28.364204 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:28.364204 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:28.364204 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:28.364204 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:28.364204 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:28.364204 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:28.364204 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:28.364204 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:28.364204 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:28.365208 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:28.365208 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:28.365208 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:08:28.365208 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:08:28.365208 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:08:28.365208 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:08:28.365208 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:08:28.365208 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:08:28.365208 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:08:28.365208 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:08:28.365208 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 428/833] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:08:28.371904 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6258e7d-7d52-4810-ae47-b645c05b605e None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:28.482655 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6258e7d-7d52-4810-ae47-b645c05b605e None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:28.521927 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec831f6c-5eb9-4e17-90ca-db9e736d97f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:28.522649 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec831f6c-5eb9-4e17-90ca-db9e736d97f9 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:28.522980 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec831f6c-5eb9-4e17-90ca-db9e736d97f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:28.523305 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec831f6c-5eb9-4e17-90ca-db9e736d97f9 None admin] PATH_INFO: `/v3/users` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:28.524129 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec831f6c-5eb9-4e17-90ca-db9e736d97f9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:28.524983 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec831f6c-5eb9-4e17-90ca-db9e736d97f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:28.526542 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec831f6c-5eb9-4e17-90ca-db9e736d97f9 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:28.549688 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 406/834] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Sep 9 11:08:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:28.556350 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58471972-2563-4180-a2d2-55568860e204 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:28.703970 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58471972-2563-4180-a2d2-55568860e204 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:28.744665 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d0ecb-d611-426c-afed-cf57c5020ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:28.744665 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d0ecb-d611-426c-afed-cf57c5020ecb None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:28.745161 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d0ecb-d611-426c-afed-cf57c5020ecb None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:28.745259 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d0ecb-d611-426c-afed-cf57c5020ecb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:28.787448 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:28.846807 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d0ecb-d611-426c-afed-cf57c5020ecb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:28.848461 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d0ecb-d611-426c-afed-cf57c5020ecb None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:28.964581 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 429/835] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:08:28 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:08:28.972920 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec831f6c-5eb9-4e17-90ca-db9e736d97f9 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:28.996270 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:29.139543 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec831f6c-5eb9-4e17-90ca-db9e736d97f9 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:29.192184 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb3715-2c50-4d33-b4c6-4f662e2b142c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:29.192867 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb3715-2c50-4d33-b4c6-4f662e2b142c None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:29.193100 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb3715-2c50-4d33-b4c6-4f662e2b142c None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:29.193391 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb3715-2c50-4d33-b4c6-4f662e2b142c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:29.205730 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb3715-2c50-4d33-b4c6-4f662e2b142c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:29.207207 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb3715-2c50-4d33-b4c6-4f662e2b142c None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:29.225480 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-36bb3715-2c50-4d33-b4c6-4f662e2b142c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:29.225480 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:29.225480 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:29.225480 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:29.225480 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:29.225480 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:29.225480 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:29.225480 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:29.225480 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:29.225480 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:29.225480 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:29.225480 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:29.225480 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:29.225480 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:29.225480 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:29.225480 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:29.226811 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:29.226811 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:29.226811 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:29.226811 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:29.226811 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:29.226811 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:29.226811 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:29.226811 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:29.226811 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:29.226811 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:29.226811 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:29.226811 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:29.226811 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:29.226811 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:29.226811 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:29.226811 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:29.226811 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:29.228803 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:29.228803 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:29.228803 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:08:29.228803 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 407/836] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:29.234768 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d0ecb-d611-426c-afed-cf57c5020ecb None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:29.309409 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:29.376224 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d0ecb-d611-426c-afed-cf57c5020ecb None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:29.419618 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c028d-3662-4468-a892-6450f645cd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:29.420502 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c028d-3662-4468-a892-6450f645cd7b None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:29.420774 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c028d-3662-4468-a892-6450f645cd7b None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:29.421043 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c028d-3662-4468-a892-6450f645cd7b None admin] PATH_INFO: `/v3/domains` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:29.421731 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c028d-3662-4468-a892-6450f645cd7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:29.422035 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c028d-3662-4468-a892-6450f645cd7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:29.423515 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c028d-3662-4468-a892-6450f645cd7b None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:29.436850 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 430/837] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:29.443401 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb3715-2c50-4d33-b4c6-4f662e2b142c None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:29.539805 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:29.578693 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb3715-2c50-4d33-b4c6-4f662e2b142c None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:29.623848 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b9ac3-fa8a-4da9-b0d0-8f4717374cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:29.624702 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b9ac3-fa8a-4da9-b0d0-8f4717374cb0 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:29.625123 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b9ac3-fa8a-4da9-b0d0-8f4717374cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:29.625509 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b9ac3-fa8a-4da9-b0d0-8f4717374cb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:29.637569 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b9ac3-fa8a-4da9-b0d0-8f4717374cb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:29.640242 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b9ac3-fa8a-4da9-b0d0-8f4717374cb0 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:29.654374 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-aa8b9ac3-fa8a-4da9-b0d0-8f4717374cb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:29.654374 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:29.654374 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:29.654374 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:29.654374 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:29.654374 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:29.654374 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:29.654374 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:29.654374 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:29.654374 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:29.654374 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:29.654374 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:29.654374 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:08:29.654374 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:08:29.654374 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:08:29.655466 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:08:29.655466 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:29.655466 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:29.655466 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:29.655466 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:29.655466 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:29.655466 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:29.655466 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:29.655466 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:29.655466 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:29.655466 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:29.655466 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:29.655466 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:29.655466 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:29.655466 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:29.655466 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:29.655466 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:29.656571 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:08:29.656571 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:08:29.656571 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:08:29.656571 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:08:29.656571 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:08:29.656571 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:08:29.656571 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:29.656571 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:08:29.656571 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 408/838] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:08:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:29.662064 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c028d-3662-4468-a892-6450f645cd7b None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:29.795025 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c028d-3662-4468-a892-6450f645cd7b None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:29.818713 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:29.853766 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433de1ec-9504-4dac-aa41-4ad47c83748d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:29.854451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433de1ec-9504-4dac-aa41-4ad47c83748d None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:29.854794 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433de1ec-9504-4dac-aa41-4ad47c83748d None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:29.855083 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433de1ec-9504-4dac-aa41-4ad47c83748d None admin] PATH_INFO: `/v3/projects` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:29.855842 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433de1ec-9504-4dac-aa41-4ad47c83748d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:29.856184 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433de1ec-9504-4dac-aa41-4ad47c83748d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:29.857845 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433de1ec-9504-4dac-aa41-4ad47c83748d None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:29.873434 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 431/839] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 9 11:08:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:29.880116 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b9ac3-fa8a-4da9-b0d0-8f4717374cb0 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:30.012716 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b9ac3-fa8a-4da9-b0d0-8f4717374cb0 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:30.065631 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:30.074193 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13dae1c-06c5-4a92-976a-140c2549d1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:30.075393 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13dae1c-06c5-4a92-976a-140c2549d1f6 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:30.075892 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13dae1c-06c5-4a92-976a-140c2549d1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:30.076387 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13dae1c-06c5-4a92-976a-140c2549d1f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:30.077781 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13dae1c-06c5-4a92-976a-140c2549d1f6 None admin] RBAC: Adding query filter params (role.id=d2efb827d8084d99971bbe82cfa142e2, scope.project.id=b9cec15abcd74e13ba458c64ad6fdf9b, user.id=ff72ca8bbc74499bb18ad4cb3ae2024c) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:30.078325 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13dae1c-06c5-4a92-976a-140c2549d1f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:30.081256 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13dae1c-06c5-4a92-976a-140c2549d1f6 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:30.091689 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 409/840] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:08:29 2022] GET /identity/v3/role_assignments?user.id=ff72ca8bbc74499bb18ad4cb3ae2024c&scope.project.id=b9cec15abcd74e13ba458c64ad6fdf9b&role.id=d2efb827d8084d99971bbe82cfa142e2 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:32.862323 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4b27f-7026-47cc-bf37-58fd94fe17e8 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:32.862888 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4b27f-7026-47cc-bf37-58fd94fe17e8 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:32.863237 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4b27f-7026-47cc-bf37-58fd94fe17e8 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:32.865302 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 432/841] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:08:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:32.872871 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a8ae0-d358-4ae0-b032-64edf359d41c None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:32.873472 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a8ae0-d358-4ae0-b032-64edf359d41c None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:32.873472 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a8ae0-d358-4ae0-b032-64edf359d41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:32.898095 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-876a8ae0-d358-4ae0-b032-64edf359d41c None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:32.900651 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-876a8ae0-d358-4ae0-b032-64edf359d41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:32.990737 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 410/842] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:32 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:08:33.336590 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4b27f-7026-47cc-bf37-58fd94fe17e8 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:33.478650 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4b27f-7026-47cc-bf37-58fd94fe17e8 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:33.516635 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd7f1a-f1c1-4285-aae1-0334a630d5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:33.517272 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd7f1a-f1c1-4285-aae1-0334a630d5d7 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:33.517579 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd7f1a-f1c1-4285-aae1-0334a630d5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:33.517851 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd7f1a-f1c1-4285-aae1-0334a630d5d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:33.528780 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd7f1a-f1c1-4285-aae1-0334a630d5d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:33.533736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-c1dd7f1a-f1c1-4285-aae1-0334a630d5d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:08:33.533736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:33.533736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:33.533736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:33.533736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:33.533736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:33.533736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:33.533736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:33.533736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:33.533736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:33.533736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:33.533736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:33.533736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:33.533736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:33.533736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:33.533736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:33.534833 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:33.534833 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:33.534833 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:33.534833 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:33.534833 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:33.534833 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:33.534833 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:33.534833 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:33.534833 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:33.534833 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:33.534833 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:33.534833 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:33.534833 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:33.534833 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:33.534833 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:33.534833 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:33.535821 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:33.535821 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:33.535821 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:33.535821 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:33.535821 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:33.535821 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:33.535821 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:33.535821 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:33.535821 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:33.535821 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:33.535821 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:08:33.535821 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:08:33.535821 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 433/843] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 9 11:08:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:33.544867 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a8ae0-d358-4ae0-b032-64edf359d41c None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:33.676882 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a8ae0-d358-4ae0-b032-64edf359d41c None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:33.714164 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:33.729572 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee5967-ff6e-4274-8bee-56e94b899e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:33.730261 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee5967-ff6e-4274-8bee-56e94b899e6b None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:33.730541 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee5967-ff6e-4274-8bee-56e94b899e6b None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:33.730814 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee5967-ff6e-4274-8bee-56e94b899e6b None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:33.731485 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee5967-ff6e-4274-8bee-56e94b899e6b None admin] RBAC: Adding query filter params (name=service) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:33.731861 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee5967-ff6e-4274-8bee-56e94b899e6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:33.733440 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee5967-ff6e-4274-8bee-56e94b899e6b None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:33.743557 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 411/844] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 9 11:08:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:33.749601 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd7f1a-f1c1-4285-aae1-0334a630d5d7 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:33.797959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:33.886194 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd7f1a-f1c1-4285-aae1-0334a630d5d7 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:33.946925 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c0a61-0ef7-4abd-967a-014a4c0d95b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:33.947856 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c0a61-0ef7-4abd-967a-014a4c0d95b4 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:33.948244 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c0a61-0ef7-4abd-967a-014a4c0d95b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:33.948642 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c0a61-0ef7-4abd-967a-014a4c0d95b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:33.967107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c0a61-0ef7-4abd-967a-014a4c0d95b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:33.968752 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c0a61-0ef7-4abd-967a-014a4c0d95b4 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:33.988394 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-b68c0a61-0ef7-4abd-967a-014a4c0d95b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:33.988394 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:33.988394 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:33.988394 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:33.988394 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:33.988394 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:33.988394 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:33.988394 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:33.988394 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:33.988394 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:33.988394 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:33.988394 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:33.988394 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:33.988394 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:33.988394 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:33.988394 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:33.990540 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:33.990540 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:33.990540 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:33.990540 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:33.990540 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:33.990540 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:33.990540 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:33.990540 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:33.990540 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:33.990540 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:33.990540 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:33.990540 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:33.990540 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:33.990540 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:33.990540 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:33.990540 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:33.990540 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:33.991583 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:33.991583 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:33.991583 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:08:33.991583 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 434/845] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:33.996556 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee5967-ff6e-4274-8bee-56e94b899e6b None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:34.131579 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee5967-ff6e-4274-8bee-56e94b899e6b None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:34.172038 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bce92c-9881-486b-bc1b-ff45e774ea12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:34.172651 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bce92c-9881-486b-bc1b-ff45e774ea12 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:34.172927 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bce92c-9881-486b-bc1b-ff45e774ea12 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:34.173201 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bce92c-9881-486b-bc1b-ff45e774ea12 None admin] PATH_INFO: `/v3/domains` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:34.174012 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bce92c-9881-486b-bc1b-ff45e774ea12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:34.174261 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bce92c-9881-486b-bc1b-ff45e774ea12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:34.175587 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bce92c-9881-486b-bc1b-ff45e774ea12 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:34.189225 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 412/846] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:34.195499 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c0a61-0ef7-4abd-967a-014a4c0d95b4 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:34.310313 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:34.324923 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c0a61-0ef7-4abd-967a-014a4c0d95b4 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:34.365111 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1a5d1-d2ff-413e-b506-c7dc920b623b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:34.366065 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1a5d1-d2ff-413e-b506-c7dc920b623b None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:34.366452 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1a5d1-d2ff-413e-b506-c7dc920b623b None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:34.366825 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1a5d1-d2ff-413e-b506-c7dc920b623b None admin] PATH_INFO: `/v3/users/placement` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:34.379980 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1a5d1-d2ff-413e-b506-c7dc920b623b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:34.382053 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1a5d1-d2ff-413e-b506-c7dc920b623b None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:34.403311 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-4dd1a5d1-d2ff-413e-b506-c7dc920b623b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:08:34.403311 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:34.403311 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:34.403311 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:34.403311 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:34.403311 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:34.403311 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:34.403311 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:34.403311 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:34.403311 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:34.403311 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:34.403311 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:34.403311 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:08:34.403311 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:08:34.403311 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:08:34.403311 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:08:34.404698 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:34.404698 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:34.404698 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:08:34.404698 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:34.404698 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:08:34.404698 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:34.404698 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:34.404698 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:34.404698 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:34.404698 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:34.404698 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:34.404698 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:34.404698 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:34.404698 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:34.404698 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:34.404698 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:34.404698 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:34.404698 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:34.406043 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:34.406043 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:34.406043 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:08:34.406043 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:08:34.406043 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:08:34.406043 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:08:34.406043 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:08:34.406043 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:08:34.406043 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:08:34.406043 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:08:34.406043 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 435/847] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:34.412828 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bce92c-9881-486b-bc1b-ff45e774ea12 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:34.475928 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:34.550909 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bce92c-9881-486b-bc1b-ff45e774ea12 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:34.597786 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5810a6-6195-4850-86af-ca4fb127ab70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:34.598800 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5810a6-6195-4850-86af-ca4fb127ab70 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:34.599324 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5810a6-6195-4850-86af-ca4fb127ab70 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:34.599746 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5810a6-6195-4850-86af-ca4fb127ab70 None admin] PATH_INFO: `/v3/users` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:34.600819 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5810a6-6195-4850-86af-ca4fb127ab70 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:34.601376 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5810a6-6195-4850-86af-ca4fb127ab70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:34.603226 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5810a6-6195-4850-86af-ca4fb127ab70 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:34.626472 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 413/848] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Sep 9 11:08:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:34.633081 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1a5d1-d2ff-413e-b506-c7dc920b623b None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:34.765133 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1a5d1-d2ff-413e-b506-c7dc920b623b None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:34.809635 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e448c-a9a2-4871-becd-e1102ec2c493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:34.810330 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e448c-a9a2-4871-becd-e1102ec2c493 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:34.810677 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e448c-a9a2-4871-becd-e1102ec2c493 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:34.810990 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e448c-a9a2-4871-becd-e1102ec2c493 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:34.824660 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e448c-a9a2-4871-becd-e1102ec2c493 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:34.826442 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e448c-a9a2-4871-becd-e1102ec2c493 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:34.857248 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-211e448c-a9a2-4871-becd-e1102ec2c493 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:34.857248 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:34.857248 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:34.857248 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:34.857248 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:34.857248 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:34.857248 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:34.857248 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:34.857248 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:34.857248 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:34.857248 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:34.857248 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:34.857248 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:34.857248 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:34.857248 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:34.857248 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:34.859516 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:34.859516 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:34.859516 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:34.859516 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:34.859516 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:34.859516 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:34.859516 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:34.859516 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:34.859516 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:34.859516 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:34.859516 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:34.859516 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:34.859516 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:34.859516 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:34.859516 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:34.859516 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:34.859516 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:34.861340 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:34.861340 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:34.861340 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:08:34.861340 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 436/849] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:34.868038 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5810a6-6195-4850-86af-ca4fb127ab70 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:35.001658 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5810a6-6195-4850-86af-ca4fb127ab70 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:35.005098 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:35.045833 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41b9ef-bdd1-4c5b-9bae-14a3c5522139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:35.046464 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41b9ef-bdd1-4c5b-9bae-14a3c5522139 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:35.046741 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41b9ef-bdd1-4c5b-9bae-14a3c5522139 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:35.047010 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41b9ef-bdd1-4c5b-9bae-14a3c5522139 None admin] PATH_INFO: `/v3/domains` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:35.047658 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41b9ef-bdd1-4c5b-9bae-14a3c5522139 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:35.047981 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41b9ef-bdd1-4c5b-9bae-14a3c5522139 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:35.049431 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41b9ef-bdd1-4c5b-9bae-14a3c5522139 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:35.063995 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 414/850] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:35.070448 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e448c-a9a2-4871-becd-e1102ec2c493 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:35.074274 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:35.209774 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e448c-a9a2-4871-becd-e1102ec2c493 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:35.254148 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83297968-cb20-4288-b3c7-10d6e0a84968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:35.254148 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83297968-cb20-4288-b3c7-10d6e0a84968 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:35.255226 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83297968-cb20-4288-b3c7-10d6e0a84968 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:35.255318 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83297968-cb20-4288-b3c7-10d6e0a84968 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:35.263869 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83297968-cb20-4288-b3c7-10d6e0a84968 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:35.265363 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83297968-cb20-4288-b3c7-10d6e0a84968 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:35.277885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-83297968-cb20-4288-b3c7-10d6e0a84968 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:35.277885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:35.277885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:35.277885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:35.277885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:35.277885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:35.277885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:35.277885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:35.277885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:35.277885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:35.277885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:35.277885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:35.277885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:08:35.277885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:08:35.277885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:08:35.278983 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:08:35.278983 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:35.278983 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:35.278983 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:35.278983 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:35.278983 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:35.278983 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:35.278983 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:35.278983 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:35.278983 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:35.278983 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:35.278983 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:35.278983 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:35.278983 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:35.278983 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:35.278983 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:35.278983 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:35.279898 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:08:35.279898 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:08:35.279898 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:08:35.279898 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:08:35.279898 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:08:35.279898 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:08:35.279898 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:35.279898 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:08:35.279898 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 437/851] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:08:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:35.289342 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41b9ef-bdd1-4c5b-9bae-14a3c5522139 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:35.423916 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41b9ef-bdd1-4c5b-9bae-14a3c5522139 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:35.468020 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d54bee-e456-466d-ac21-bb44c1728c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:35.468572 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d54bee-e456-466d-ac21-bb44c1728c93 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:35.468824 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d54bee-e456-466d-ac21-bb44c1728c93 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:35.469105 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d54bee-e456-466d-ac21-bb44c1728c93 None admin] PATH_INFO: `/v3/projects` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:35.469874 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d54bee-e456-466d-ac21-bb44c1728c93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:35.470217 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d54bee-e456-466d-ac21-bb44c1728c93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:35.471788 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d54bee-e456-466d-ac21-bb44c1728c93 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:35.486777 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 415/852] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 9 11:08:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:35.494013 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83297968-cb20-4288-b3c7-10d6e0a84968 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:35.588594 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:35.643251 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83297968-cb20-4288-b3c7-10d6e0a84968 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:35.683492 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d7678-1398-4b86-b02b-02ca4069155f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:35.684474 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d7678-1398-4b86-b02b-02ca4069155f None admin] REQUEST_METHOD: `PUT` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:35.684757 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d7678-1398-4b86-b02b-02ca4069155f None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:35.685310 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d7678-1398-4b86-b02b-02ca4069155f None admin] PATH_INFO: `/v3/projects/b9cec15abcd74e13ba458c64ad6fdf9b/users/ff72ca8bbc74499bb18ad4cb3ae2024c/roles/d2efb827d8084d99971bbe82cfa142e2` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:35.707032 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d7678-1398-4b86-b02b-02ca4069155f None admin] RBAC: Authorizing `identity:create_grant(project_id=b9cec15abcd74e13ba458c64ad6fdf9b, user_id=ff72ca8bbc74499bb18ad4cb3ae2024c, role_id=d2efb827d8084d99971bbe82cfa142e2)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:35.709052 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d7678-1398-4b86-b02b-02ca4069155f None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:35.726117 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 438/853] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 9 11:08:35 2022] PUT /identity/v3/projects/b9cec15abcd74e13ba458c64ad6fdf9b/users/ff72ca8bbc74499bb18ad4cb3ae2024c/roles/d2efb827d8084d99971bbe82cfa142e2 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:08:38.534961 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36479cb7-1663-4718-a2dc-770055d0894a None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:38.535637 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36479cb7-1663-4718-a2dc-770055d0894a None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:38.535637 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36479cb7-1663-4718-a2dc-770055d0894a None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:38.536876 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 416/854] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:38.546907 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c67a5-4937-4f42-8238-cfbe2f7baf20 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:38.547470 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c67a5-4937-4f42-8238-cfbe2f7baf20 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:38.547762 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c67a5-4937-4f42-8238-cfbe2f7baf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:38.570013 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-db3c67a5-4937-4f42-8238-cfbe2f7baf20 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:38.571224 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-db3c67a5-4937-4f42-8238-cfbe2f7baf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:38.665327 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 439/855] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:38 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:08:39.014053 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36479cb7-1663-4718-a2dc-770055d0894a None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:39.057490 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:39.146665 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36479cb7-1663-4718-a2dc-770055d0894a None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:39.195537 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406d72e-82b6-46ea-9685-b90bd4b25037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:39.196181 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406d72e-82b6-46ea-9685-b90bd4b25037 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:39.196461 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406d72e-82b6-46ea-9685-b90bd4b25037 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:39.196728 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406d72e-82b6-46ea-9685-b90bd4b25037 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:39.217884 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406d72e-82b6-46ea-9685-b90bd4b25037 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:39.223062 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-b406d72e-82b6-46ea-9685-b90bd4b25037 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:08:39.223062 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:39.223062 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:39.223062 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:39.223062 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:39.223062 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:39.223062 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:39.223062 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:39.223062 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:39.223062 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:39.223062 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:39.223062 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:39.223062 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:39.223062 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:39.223062 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:39.223062 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:39.224894 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:39.224894 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:39.224894 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:39.224894 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:39.224894 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:39.224894 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:39.224894 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:39.224894 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:39.224894 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:39.224894 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:39.224894 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:39.224894 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:39.224894 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:39.224894 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:39.224894 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:39.224894 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:39.226567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:39.226567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:39.226567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:39.226567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:39.226567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:39.226567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:39.226567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:39.226567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:39.226567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:39.226567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:39.226567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:08:39.226567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:08:39.226567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 417/856] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 9 11:08:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:39.235028 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c67a5-4937-4f42-8238-cfbe2f7baf20 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:39.289964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:39.377932 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c67a5-4937-4f42-8238-cfbe2f7baf20 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:39.417996 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f17ac2-f362-4f82-a519-8119bd0cc06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:39.418863 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f17ac2-f362-4f82-a519-8119bd0cc06e None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:39.419336 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f17ac2-f362-4f82-a519-8119bd0cc06e None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:39.419725 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f17ac2-f362-4f82-a519-8119bd0cc06e None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:39.420384 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f17ac2-f362-4f82-a519-8119bd0cc06e None admin] RBAC: Adding query filter params (name=service) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:39.420742 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f17ac2-f362-4f82-a519-8119bd0cc06e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:39.422358 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f17ac2-f362-4f82-a519-8119bd0cc06e None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:39.431743 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 440/857] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 9 11:08:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:39.439204 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406d72e-82b6-46ea-9685-b90bd4b25037 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:39.555319 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:39.578384 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406d72e-82b6-46ea-9685-b90bd4b25037 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:39.622217 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4e4b0-fe43-4406-b43a-d8131d6013f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:39.622859 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4e4b0-fe43-4406-b43a-d8131d6013f5 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:39.623193 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4e4b0-fe43-4406-b43a-d8131d6013f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:39.623557 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4e4b0-fe43-4406-b43a-d8131d6013f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:39.635706 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e4e4b0-fe43-4406-b43a-d8131d6013f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:39.637184 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e4e4b0-fe43-4406-b43a-d8131d6013f5 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:39.658350 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-97e4e4b0-fe43-4406-b43a-d8131d6013f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:39.658350 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:39.658350 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:39.658350 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:39.658350 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:39.658350 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:39.658350 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:39.658350 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:39.658350 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:39.658350 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:39.658350 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:39.658350 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:39.658350 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:39.658350 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:39.658350 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:39.658350 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:39.660579 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:39.660579 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:39.660579 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:39.660579 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:39.660579 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:39.660579 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:39.660579 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:39.660579 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:39.660579 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:39.660579 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:39.660579 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:39.660579 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:39.660579 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:39.660579 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:39.660579 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:39.660579 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:39.660579 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:39.662187 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:39.662187 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:39.662187 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:08:39.663003 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 418/858] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:08:39.670407 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f17ac2-f362-4f82-a519-8119bd0cc06e None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:39.796278 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f17ac2-f362-4f82-a519-8119bd0cc06e None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:39.798889 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:39.839058 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf7548-a51f-40fa-a9c0-93a294d944ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:39.839877 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf7548-a51f-40fa-a9c0-93a294d944ea None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:39.840379 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf7548-a51f-40fa-a9c0-93a294d944ea None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:39.840851 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf7548-a51f-40fa-a9c0-93a294d944ea None admin] PATH_INFO: `/v3/domains` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:39.841861 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf7548-a51f-40fa-a9c0-93a294d944ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:39.842346 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf7548-a51f-40fa-a9c0-93a294d944ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:39.844295 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf7548-a51f-40fa-a9c0-93a294d944ea None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:39.860211 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 441/859] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:39.868472 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4e4b0-fe43-4406-b43a-d8131d6013f5 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:40.028009 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4e4b0-fe43-4406-b43a-d8131d6013f5 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:40.070196 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b7ec3-9b8c-4a13-a183-504f78955e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:40.071068 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b7ec3-9b8c-4a13-a183-504f78955e41 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:40.071447 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b7ec3-9b8c-4a13-a183-504f78955e41 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:40.071825 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b7ec3-9b8c-4a13-a183-504f78955e41 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:40.075858 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:40.082362 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b7ec3-9b8c-4a13-a183-504f78955e41 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:40.084384 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b7ec3-9b8c-4a13-a183-504f78955e41 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:40.098010 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-522b7ec3-9b8c-4a13-a183-504f78955e41 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:08:40.098010 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:40.098010 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:40.098010 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:40.098010 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:40.098010 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:40.098010 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:40.098010 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:40.098010 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:40.098010 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:40.098010 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:40.098010 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:40.098010 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:08:40.098010 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:08:40.098010 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:08:40.098010 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:08:40.099931 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:40.099931 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:40.099931 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:08:40.099931 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:40.099931 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:08:40.099931 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:40.099931 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:40.099931 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:40.099931 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:40.099931 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:40.099931 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:40.099931 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:40.099931 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:40.099931 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:40.099931 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:40.099931 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:40.099931 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:40.099931 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:40.101812 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:40.101812 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:40.101812 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:08:40.101812 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:08:40.101812 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:08:40.101812 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:08:40.101812 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:08:40.101812 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:08:40.101812 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:08:40.101812 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:08:40.101812 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 419/860] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:40.107714 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf7548-a51f-40fa-a9c0-93a294d944ea None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:40.256849 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf7548-a51f-40fa-a9c0-93a294d944ea None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:40.302432 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a4688-6000-42bd-8a66-776d20bf2406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:40.303462 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a4688-6000-42bd-8a66-776d20bf2406 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:40.303845 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a4688-6000-42bd-8a66-776d20bf2406 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:40.304353 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a4688-6000-42bd-8a66-776d20bf2406 None admin] PATH_INFO: `/v3/users` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:40.305517 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a4688-6000-42bd-8a66-776d20bf2406 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:40.306029 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a4688-6000-42bd-8a66-776d20bf2406 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:40.308162 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a4688-6000-42bd-8a66-776d20bf2406 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:40.332101 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 442/861] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Sep 9 11:08:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:40.339192 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b7ec3-9b8c-4a13-a183-504f78955e41 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:40.475716 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b7ec3-9b8c-4a13-a183-504f78955e41 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:40.519554 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fcbe5-88c8-4d91-92b4-5fd3a9c75347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:40.520181 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fcbe5-88c8-4d91-92b4-5fd3a9c75347 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:40.520464 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fcbe5-88c8-4d91-92b4-5fd3a9c75347 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:40.520733 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fcbe5-88c8-4d91-92b4-5fd3a9c75347 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:40.609651 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:40.617447 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8fcbe5-88c8-4d91-92b4-5fd3a9c75347 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:40.619979 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8fcbe5-88c8-4d91-92b4-5fd3a9c75347 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:40.747504 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 420/862] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:08:40 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:08:40.754110 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a4688-6000-42bd-8a66-776d20bf2406 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:40.783219 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:40.908880 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a4688-6000-42bd-8a66-776d20bf2406 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:40.960070 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83bde9-8d06-4096-8346-c94f8f93d246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:40.960711 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83bde9-8d06-4096-8346-c94f8f93d246 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:40.960988 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83bde9-8d06-4096-8346-c94f8f93d246 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:40.961302 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83bde9-8d06-4096-8346-c94f8f93d246 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:40.977646 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83bde9-8d06-4096-8346-c94f8f93d246 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:40.980800 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83bde9-8d06-4096-8346-c94f8f93d246 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:41.001662 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-bd83bde9-8d06-4096-8346-c94f8f93d246 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:41.001662 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:41.001662 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:41.001662 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:41.001662 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:41.001662 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:41.001662 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:41.001662 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:41.001662 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:41.001662 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:41.001662 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:41.001662 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:41.001662 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:41.001662 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:41.001662 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:41.001662 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:41.002778 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:41.002778 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:41.002778 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:41.002778 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:41.002778 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:41.002778 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:41.002778 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:41.002778 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:41.002778 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:41.002778 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:41.002778 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:41.002778 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:41.002778 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:41.002778 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:41.002778 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:41.002778 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:41.002778 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:41.003719 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:41.003719 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:41.003719 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:08:41.003719 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 443/863] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:41.011292 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fcbe5-88c8-4d91-92b4-5fd3a9c75347 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:41.136105 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:41.144598 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fcbe5-88c8-4d91-92b4-5fd3a9c75347 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:41.187086 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1575f-e868-4b04-8d42-16887b3adcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:41.187729 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1575f-e868-4b04-8d42-16887b3adcc7 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:41.188072 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1575f-e868-4b04-8d42-16887b3adcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:41.188347 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1575f-e868-4b04-8d42-16887b3adcc7 None admin] PATH_INFO: `/v3/domains` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:41.189002 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1575f-e868-4b04-8d42-16887b3adcc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:41.189326 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1575f-e868-4b04-8d42-16887b3adcc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:41.190762 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1575f-e868-4b04-8d42-16887b3adcc7 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:41.210665 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 421/864] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:41.217981 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83bde9-8d06-4096-8346-c94f8f93d246 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:41.335691 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:41.373362 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83bde9-8d06-4096-8346-c94f8f93d246 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:41.420555 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1630c-5467-4d97-a3de-7d510840c501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:41.421728 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1630c-5467-4d97-a3de-7d510840c501 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:41.421728 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1630c-5467-4d97-a3de-7d510840c501 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:41.422231 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1630c-5467-4d97-a3de-7d510840c501 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:41.430268 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1630c-5467-4d97-a3de-7d510840c501 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:41.432264 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1630c-5467-4d97-a3de-7d510840c501 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:41.450410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-80f1630c-5467-4d97-a3de-7d510840c501 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:41.450410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:41.450410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:41.450410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:41.450410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:41.450410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:41.450410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:41.450410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:41.450410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:41.450410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:41.450410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:41.450410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:41.450410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:08:41.450410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:08:41.450410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:08:41.451457 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:08:41.451457 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:41.451457 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:41.451457 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:41.451457 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:41.451457 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:41.451457 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:41.451457 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:41.451457 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:41.451457 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:41.451457 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:41.451457 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:41.451457 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:41.451457 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:41.451457 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:41.451457 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:41.451457 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:41.452433 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:08:41.452433 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:08:41.452433 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:08:41.452433 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:08:41.452433 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:08:41.452433 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:08:41.452433 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:41.452433 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:08:41.452433 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 444/865] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:08:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:41.460342 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1575f-e868-4b04-8d42-16887b3adcc7 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:41.586320 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1575f-e868-4b04-8d42-16887b3adcc7 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:41.636417 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780d0e7-239b-406a-b4d4-c87458b4fd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:41.637822 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780d0e7-239b-406a-b4d4-c87458b4fd4e None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:41.638097 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780d0e7-239b-406a-b4d4-c87458b4fd4e None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:41.638406 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780d0e7-239b-406a-b4d4-c87458b4fd4e None admin] PATH_INFO: `/v3/projects` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:41.639093 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780d0e7-239b-406a-b4d4-c87458b4fd4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:41.639413 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780d0e7-239b-406a-b4d4-c87458b4fd4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:41.640903 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780d0e7-239b-406a-b4d4-c87458b4fd4e None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:41.654626 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 422/866] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 9 11:08:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:41.660854 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1630c-5467-4d97-a3de-7d510840c501 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:41.784728 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1630c-5467-4d97-a3de-7d510840c501 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:41.846659 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c87f9e-0917-40ee-86aa-05ca15f6eb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:41.847204 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c87f9e-0917-40ee-86aa-05ca15f6eb6e None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:41.847487 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c87f9e-0917-40ee-86aa-05ca15f6eb6e None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:41.847700 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c87f9e-0917-40ee-86aa-05ca15f6eb6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:41.848858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c87f9e-0917-40ee-86aa-05ca15f6eb6e None admin] RBAC: Adding query filter params (role.id=d2efb827d8084d99971bbe82cfa142e2, scope.project.id=b9cec15abcd74e13ba458c64ad6fdf9b, user.id=ff72ca8bbc74499bb18ad4cb3ae2024c) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:41.848858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c87f9e-0917-40ee-86aa-05ca15f6eb6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:41.850309 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c87f9e-0917-40ee-86aa-05ca15f6eb6e None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:41.852766 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:41.859445 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 445/867] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:08:41 2022] GET /identity/v3/role_assignments?user.id=ff72ca8bbc74499bb18ad4cb3ae2024c&scope.project.id=b9cec15abcd74e13ba458c64ad6fdf9b&role.id=d2efb827d8084d99971bbe82cfa142e2 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:44.418719 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfb676-7e67-44b0-85be-c11dad5a1b9a None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:44.419388 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfb676-7e67-44b0-85be-c11dad5a1b9a None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:44.419388 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfb676-7e67-44b0-85be-c11dad5a1b9a None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:44.420586 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 423/868] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:44.426676 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99cdbf-cb06-4026-a0eb-39fd859765ea None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:44.427248 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99cdbf-cb06-4026-a0eb-39fd859765ea None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:44.427248 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99cdbf-cb06-4026-a0eb-39fd859765ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:44.450337 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-7c99cdbf-cb06-4026-a0eb-39fd859765ea None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:44.455073 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-7c99cdbf-cb06-4026-a0eb-39fd859765ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:44.531928 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 446/869] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:44 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:08:44.891927 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfb676-7e67-44b0-85be-c11dad5a1b9a None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:44.912110 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:45.027615 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfb676-7e67-44b0-85be-c11dad5a1b9a None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:45.077227 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e73ac5-6fb1-461c-9019-60e3312f6963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:45.078016 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e73ac5-6fb1-461c-9019-60e3312f6963 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:45.078341 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e73ac5-6fb1-461c-9019-60e3312f6963 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:45.078667 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e73ac5-6fb1-461c-9019-60e3312f6963 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:45.096179 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e73ac5-6fb1-461c-9019-60e3312f6963 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:45.103784 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-11e73ac5-6fb1-461c-9019-60e3312f6963 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:08:45.103784 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:45.103784 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:45.103784 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:45.103784 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:45.103784 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:45.103784 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:45.103784 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:45.103784 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:45.103784 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:45.103784 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:45.103784 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:45.103784 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:45.103784 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:45.103784 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:45.103784 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:45.105104 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:45.105104 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:45.105104 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:45.105104 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:45.105104 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:45.105104 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:45.105104 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:45.105104 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:45.105104 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:45.105104 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:45.105104 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:45.105104 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:45.105104 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:45.105104 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:45.105104 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:45.105104 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:45.106060 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:45.106060 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:45.106060 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:45.106060 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:45.106060 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:45.106060 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:45.106060 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:45.106060 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:45.106060 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:45.106060 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:45.106060 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:08:45.106060 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:08:45.106060 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 424/870] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 9 11:08:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:08:45.116017 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99cdbf-cb06-4026-a0eb-39fd859765ea None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:45.247794 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99cdbf-cb06-4026-a0eb-39fd859765ea None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:45.280674 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:45.290922 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b47856-7659-461e-bf33-031d7358159f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:45.292075 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b47856-7659-461e-bf33-031d7358159f None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:45.292354 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b47856-7659-461e-bf33-031d7358159f None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:45.292622 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b47856-7659-461e-bf33-031d7358159f None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:45.293351 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b47856-7659-461e-bf33-031d7358159f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:45.293788 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b47856-7659-461e-bf33-031d7358159f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:45.295151 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b47856-7659-461e-bf33-031d7358159f None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:45.311140 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 447/871] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:08:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:45.318476 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e73ac5-6fb1-461c-9019-60e3312f6963 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:45.428765 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:45.460083 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e73ac5-6fb1-461c-9019-60e3312f6963 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:45.512250 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92b3fc-197e-49c3-9f78-a7ea1dc59bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:45.513138 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92b3fc-197e-49c3-9f78-a7ea1dc59bcd None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:45.513654 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92b3fc-197e-49c3-9f78-a7ea1dc59bcd None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:45.514118 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92b3fc-197e-49c3-9f78-a7ea1dc59bcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:45.532167 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92b3fc-197e-49c3-9f78-a7ea1dc59bcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:45.533910 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92b3fc-197e-49c3-9f78-a7ea1dc59bcd None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:45.554071 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-5d92b3fc-197e-49c3-9f78-a7ea1dc59bcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:45.554071 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:45.554071 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:45.554071 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:45.554071 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:45.554071 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:45.554071 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:45.554071 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:45.554071 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:45.554071 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:45.554071 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:45.554071 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:45.554071 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:45.554071 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:45.554071 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:45.554071 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:45.555154 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:45.555154 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:45.555154 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:45.555154 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:45.555154 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:45.555154 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:45.555154 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:45.555154 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:45.555154 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:45.555154 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:45.555154 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:45.555154 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:45.555154 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:45.555154 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:45.555154 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:45.555154 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:45.555154 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:45.556039 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:45.556039 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:45.556039 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:08:45.556039 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 425/872] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:08:45.562198 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b47856-7659-461e-bf33-031d7358159f None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:45.711199 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b47856-7659-461e-bf33-031d7358159f None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:45.749426 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c116339-beb6-4033-84bf-86964d47d774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:45.750150 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c116339-beb6-4033-84bf-86964d47d774 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:45.750410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c116339-beb6-4033-84bf-86964d47d774 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:45.750674 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c116339-beb6-4033-84bf-86964d47d774 None admin] PATH_INFO: `/v3/domains` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:45.751482 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c116339-beb6-4033-84bf-86964d47d774 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:45.751865 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c116339-beb6-4033-84bf-86964d47d774 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:45.753256 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c116339-beb6-4033-84bf-86964d47d774 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:45.776476 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 448/873] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:45.783523 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92b3fc-197e-49c3-9f78-a7ea1dc59bcd None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:45.932834 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92b3fc-197e-49c3-9f78-a7ea1dc59bcd None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:45.965886 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:45.975500 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586ff98-d6d8-4252-81c2-aa5add1f648c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:45.976321 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586ff98-d6d8-4252-81c2-aa5add1f648c None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:45.976709 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586ff98-d6d8-4252-81c2-aa5add1f648c None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:45.977104 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586ff98-d6d8-4252-81c2-aa5add1f648c None admin] PATH_INFO: `/v3/users/placement` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:45.987593 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586ff98-d6d8-4252-81c2-aa5add1f648c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:45.989381 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586ff98-d6d8-4252-81c2-aa5add1f648c None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:46.002567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-5586ff98-d6d8-4252-81c2-aa5add1f648c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:08:46.002567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:46.002567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:46.002567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:46.002567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:46.002567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:46.002567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:46.002567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:46.002567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:46.002567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:46.002567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:46.002567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:46.002567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:08:46.002567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:08:46.002567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:08:46.002567 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:08:46.003611 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:46.003611 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:46.003611 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:08:46.003611 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:46.003611 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:08:46.003611 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:46.003611 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:46.003611 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:46.003611 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:46.003611 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:46.003611 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:46.003611 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:46.003611 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:46.003611 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:46.003611 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:46.003611 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:46.003611 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:46.003611 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:46.004879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:46.004879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:46.004879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:08:46.004879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:08:46.004879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:08:46.004879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:08:46.004879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:08:46.004879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:08:46.004879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:08:46.004879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:08:46.004879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 426/874] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:46.010721 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c116339-beb6-4033-84bf-86964d47d774 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:46.075106 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:46.137934 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c116339-beb6-4033-84bf-86964d47d774 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:46.182648 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669004e0-1c74-4afd-ae9c-0b06a2ae93d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:46.183275 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669004e0-1c74-4afd-ae9c-0b06a2ae93d6 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:46.183557 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669004e0-1c74-4afd-ae9c-0b06a2ae93d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:46.183829 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669004e0-1c74-4afd-ae9c-0b06a2ae93d6 None admin] PATH_INFO: `/v3/users` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:46.184572 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669004e0-1c74-4afd-ae9c-0b06a2ae93d6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:46.184870 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669004e0-1c74-4afd-ae9c-0b06a2ae93d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:46.186360 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669004e0-1c74-4afd-ae9c-0b06a2ae93d6 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:46.207777 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 449/875] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Sep 9 11:08:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:46.214971 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586ff98-d6d8-4252-81c2-aa5add1f648c None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:46.355700 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586ff98-d6d8-4252-81c2-aa5add1f648c None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:46.407186 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e050b-7c83-48a3-b220-bb8241709253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:46.407810 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e050b-7c83-48a3-b220-bb8241709253 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:46.408090 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e050b-7c83-48a3-b220-bb8241709253 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:46.408360 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e050b-7c83-48a3-b220-bb8241709253 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:46.472706 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:46.492033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e050b-7c83-48a3-b220-bb8241709253 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:46.494579 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e050b-7c83-48a3-b220-bb8241709253 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:46.645759 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 427/876] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:08:46 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 11:08:46.652701 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669004e0-1c74-4afd-ae9c-0b06a2ae93d6 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:46.771690 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669004e0-1c74-4afd-ae9c-0b06a2ae93d6 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:46.782483 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:46.809308 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b4110-2cd5-492c-8082-a84eb2643f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:46.810041 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b4110-2cd5-492c-8082-a84eb2643f97 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:46.810325 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b4110-2cd5-492c-8082-a84eb2643f97 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:46.810704 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b4110-2cd5-492c-8082-a84eb2643f97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:46.824401 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b4110-2cd5-492c-8082-a84eb2643f97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:46.826922 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b4110-2cd5-492c-8082-a84eb2643f97 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:46.847083 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-b99b4110-2cd5-492c-8082-a84eb2643f97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:46.847083 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:46.847083 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:46.847083 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:46.847083 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:46.847083 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:46.847083 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:46.847083 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:46.847083 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:46.847083 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:46.847083 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:46.847083 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:46.847083 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:46.847083 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:46.847083 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:46.847083 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:46.849107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:46.849107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:46.849107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:46.849107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:46.849107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:46.849107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:46.849107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:46.849107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:46.849107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:46.849107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:46.849107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:46.849107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:46.849107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:46.849107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:46.849107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:46.849107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:46.849107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:46.850897 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:46.850897 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:46.850897 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:08:46.850897 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 450/877] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:08:46.855295 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e050b-7c83-48a3-b220-bb8241709253 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:46.949845 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:46.962475 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e050b-7c83-48a3-b220-bb8241709253 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:46.998750 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab25f9-e7e6-4800-906f-bb78173074d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:46.999360 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab25f9-e7e6-4800-906f-bb78173074d5 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:46.999637 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab25f9-e7e6-4800-906f-bb78173074d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:46.999902 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab25f9-e7e6-4800-906f-bb78173074d5 None admin] PATH_INFO: `/v3/domains` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:47.000535 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab25f9-e7e6-4800-906f-bb78173074d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:47.000831 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab25f9-e7e6-4800-906f-bb78173074d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:47.002210 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab25f9-e7e6-4800-906f-bb78173074d5 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:47.014355 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 428/878] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:47.020157 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b4110-2cd5-492c-8082-a84eb2643f97 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:47.125658 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b4110-2cd5-492c-8082-a84eb2643f97 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:47.163885 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70d0ba-c4dc-4593-84ec-37eac00e893b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:47.164517 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70d0ba-c4dc-4593-84ec-37eac00e893b None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:47.164793 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70d0ba-c4dc-4593-84ec-37eac00e893b None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:47.165061 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70d0ba-c4dc-4593-84ec-37eac00e893b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:47.172597 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70d0ba-c4dc-4593-84ec-37eac00e893b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:47.174116 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70d0ba-c4dc-4593-84ec-37eac00e893b None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:47.186260 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-8d70d0ba-c4dc-4593-84ec-37eac00e893b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:47.186260 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:47.186260 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:47.186260 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:47.186260 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:47.186260 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:47.186260 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:47.186260 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:47.186260 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:47.186260 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:47.186260 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:47.186260 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:47.186260 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:08:47.186260 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:08:47.186260 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:08:47.187895 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:08:47.187895 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:47.187895 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:47.187895 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:47.187895 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:47.187895 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:47.187895 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:47.187895 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:47.187895 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:47.187895 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:47.187895 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:47.187895 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:47.187895 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:47.187895 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:47.187895 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:47.187895 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:47.187895 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:47.189932 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:08:47.189932 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:08:47.189932 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:08:47.189932 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:08:47.189932 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:08:47.189932 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:08:47.189932 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:47.189932 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:08:47.189932 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 451/879] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:08:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:47.194985 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab25f9-e7e6-4800-906f-bb78173074d5 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:47.310868 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab25f9-e7e6-4800-906f-bb78173074d5 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:47.344105 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4002e-839d-4869-b84e-326246931407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:47.344709 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4002e-839d-4869-b84e-326246931407 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:47.344981 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4002e-839d-4869-b84e-326246931407 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:47.345247 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4002e-839d-4869-b84e-326246931407 None admin] PATH_INFO: `/v3/projects` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:47.345951 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4002e-839d-4869-b84e-326246931407 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:47.346247 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4002e-839d-4869-b84e-326246931407 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:47.347678 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4002e-839d-4869-b84e-326246931407 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:47.359992 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 429/880] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 9 11:08:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:47.366371 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70d0ba-c4dc-4593-84ec-37eac00e893b None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:47.393568 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:47.478141 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70d0ba-c4dc-4593-84ec-37eac00e893b None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:47.515825 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924426c-601a-44d4-b1ec-1d504d98bf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:47.516435 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924426c-601a-44d4-b1ec-1d504d98bf66 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:47.516724 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924426c-601a-44d4-b1ec-1d504d98bf66 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:47.516991 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924426c-601a-44d4-b1ec-1d504d98bf66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:47.517763 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924426c-601a-44d4-b1ec-1d504d98bf66 None admin] RBAC: Adding query filter params (role.id=b02ba8c157bf46f4a75cdab917db78db, scope.project.id=b9cec15abcd74e13ba458c64ad6fdf9b, user.id=ff72ca8bbc74499bb18ad4cb3ae2024c) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:47.518069 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924426c-601a-44d4-b1ec-1d504d98bf66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:47.519501 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924426c-601a-44d4-b1ec-1d504d98bf66 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:47.526130 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 452/881] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:08:47 2022] GET /identity/v3/role_assignments?user.id=ff72ca8bbc74499bb18ad4cb3ae2024c&scope.project.id=b9cec15abcd74e13ba458c64ad6fdf9b&role.id=b02ba8c157bf46f4a75cdab917db78db => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:50.008865 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9a167-385e-4860-84d1-ac9396de681d None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:50.009544 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9a167-385e-4860-84d1-ac9396de681d None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:50.009544 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9a167-385e-4860-84d1-ac9396de681d None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:50.011415 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 430/882] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:08:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:50.018583 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa9666-1eb6-453f-85e2-f0184b5a77a7 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:50.019143 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa9666-1eb6-453f-85e2-f0184b5a77a7 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:50.019541 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa9666-1eb6-453f-85e2-f0184b5a77a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:50.045147 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-d8aa9666-1eb6-453f-85e2-f0184b5a77a7 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:50.046463 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-d8aa9666-1eb6-453f-85e2-f0184b5a77a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:50.115450 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 453/883] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:50 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:08:50.449693 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9a167-385e-4860-84d1-ac9396de681d None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:50.460630 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:50.554673 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9a167-385e-4860-84d1-ac9396de681d None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:50.590201 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d26368-25bb-4edd-a9ad-fd142a309549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:50.590760 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d26368-25bb-4edd-a9ad-fd142a309549 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:50.591041 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d26368-25bb-4edd-a9ad-fd142a309549 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:50.591312 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d26368-25bb-4edd-a9ad-fd142a309549 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:50.602193 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d26368-25bb-4edd-a9ad-fd142a309549 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:50.607583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-74d26368-25bb-4edd-a9ad-fd142a309549 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:08:50.607583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:50.607583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:50.607583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:50.607583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:50.607583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:50.607583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:50.607583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:50.607583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:50.607583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:50.607583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:50.607583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:50.607583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:50.607583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:50.607583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:50.607583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:50.608735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:50.608735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:50.608735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:50.608735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:50.608735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:50.608735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:50.608735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:50.608735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:50.608735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:50.608735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:50.608735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:50.608735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:50.608735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:50.608735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:50.608735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:50.608735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:50.610008 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:50.610008 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:50.610008 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:50.610008 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:50.610008 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:50.610008 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:50.610008 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:50.610008 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:50.610008 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:50.610008 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:50.610008 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:08:50.610008 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:08:50.610008 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 431/884] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 9 11:08:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:50.615066 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa9666-1eb6-453f-85e2-f0184b5a77a7 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:50.631337 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:50.722087 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa9666-1eb6-453f-85e2-f0184b5a77a7 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:50.759022 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1b80c-b514-409d-b938-3ab23f1522ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:50.759681 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1b80c-b514-409d-b938-3ab23f1522ba None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:50.760494 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1b80c-b514-409d-b938-3ab23f1522ba None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:50.760811 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1b80c-b514-409d-b938-3ab23f1522ba None admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:50.761551 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1b80c-b514-409d-b938-3ab23f1522ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:50.761908 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1b80c-b514-409d-b938-3ab23f1522ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:50.763307 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1b80c-b514-409d-b938-3ab23f1522ba None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:50.771848 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 454/885] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:08:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:50.778395 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d26368-25bb-4edd-a9ad-fd142a309549 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:50.862543 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:50.903841 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d26368-25bb-4edd-a9ad-fd142a309549 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:50.939540 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11d0ae-61db-4abf-a117-3102aaf75a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:50.940165 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11d0ae-61db-4abf-a117-3102aaf75a84 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:50.940442 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11d0ae-61db-4abf-a117-3102aaf75a84 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:50.940706 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11d0ae-61db-4abf-a117-3102aaf75a84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:50.951202 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11d0ae-61db-4abf-a117-3102aaf75a84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:50.952657 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11d0ae-61db-4abf-a117-3102aaf75a84 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:50.968056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-9c11d0ae-61db-4abf-a117-3102aaf75a84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:50.968056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:50.968056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:50.968056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:50.968056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:50.968056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:50.968056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:50.968056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:50.968056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:50.968056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:50.968056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:50.968056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:50.968056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:50.968056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:50.968056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:50.968056 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:50.969916 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:50.969916 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:50.969916 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:50.969916 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:50.969916 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:50.969916 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:50.969916 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:50.969916 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:50.969916 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:50.969916 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:50.969916 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:50.969916 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:50.969916 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:50.969916 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:50.969916 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:50.969916 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:50.969916 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:50.971762 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:50.971762 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:50.971762 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:08:50.971762 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 432/886] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:50.976376 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1b80c-b514-409d-b938-3ab23f1522ba None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:51.075183 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:51.098948 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1b80c-b514-409d-b938-3ab23f1522ba None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:51.133760 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459693a-7eb2-40cd-abc4-8c51860de3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:51.134281 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459693a-7eb2-40cd-abc4-8c51860de3b1 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:51.134561 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459693a-7eb2-40cd-abc4-8c51860de3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:51.134834 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459693a-7eb2-40cd-abc4-8c51860de3b1 None admin] PATH_INFO: `/v3/domains` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:51.135501 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459693a-7eb2-40cd-abc4-8c51860de3b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:51.135803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459693a-7eb2-40cd-abc4-8c51860de3b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:51.137166 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459693a-7eb2-40cd-abc4-8c51860de3b1 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:51.149443 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 455/887] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:51.155781 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11d0ae-61db-4abf-a117-3102aaf75a84 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:51.258263 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11d0ae-61db-4abf-a117-3102aaf75a84 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:51.281753 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:51.297879 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a4ea0-92a2-4fb7-9fb9-184bd3d4ca00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:51.298521 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a4ea0-92a2-4fb7-9fb9-184bd3d4ca00 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:51.298804 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a4ea0-92a2-4fb7-9fb9-184bd3d4ca00 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:51.299080 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a4ea0-92a2-4fb7-9fb9-184bd3d4ca00 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:51.307493 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a4ea0-92a2-4fb7-9fb9-184bd3d4ca00 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:51.308947 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a4ea0-92a2-4fb7-9fb9-184bd3d4ca00 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:51.320797 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-387a4ea0-92a2-4fb7-9fb9-184bd3d4ca00 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:08:51.320797 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:51.320797 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:51.320797 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:51.320797 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:51.320797 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:51.320797 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:51.320797 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:51.320797 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:51.320797 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:51.320797 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:51.320797 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:51.320797 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:08:51.320797 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:08:51.320797 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:08:51.320797 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:08:51.321881 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:51.321881 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:51.321881 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:08:51.321881 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:51.321881 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:08:51.321881 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:51.321881 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:51.321881 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:51.321881 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:51.321881 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:51.321881 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:51.321881 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:51.321881 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:51.321881 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:51.321881 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:51.321881 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:51.321881 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:51.321881 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:51.323360 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:51.323360 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:51.323360 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:08:51.323360 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:08:51.323360 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:08:51.323360 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:08:51.323360 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:08:51.323360 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:08:51.323360 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:08:51.323360 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:08:51.323360 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 433/888] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:51.329046 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459693a-7eb2-40cd-abc4-8c51860de3b1 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:51.432167 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459693a-7eb2-40cd-abc4-8c51860de3b1 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:51.467077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff912b5-775d-46c1-915b-831466b71828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:51.467681 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff912b5-775d-46c1-915b-831466b71828 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:51.467963 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff912b5-775d-46c1-915b-831466b71828 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:51.468238 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff912b5-775d-46c1-915b-831466b71828 None admin] PATH_INFO: `/v3/users` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:51.468973 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff912b5-775d-46c1-915b-831466b71828 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:51.469311 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff912b5-775d-46c1-915b-831466b71828 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:51.470727 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff912b5-775d-46c1-915b-831466b71828 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:51.473491 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:51.489616 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 456/889] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Sep 9 11:08:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:51.495466 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a4ea0-92a2-4fb7-9fb9-184bd3d4ca00 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:51.599551 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a4ea0-92a2-4fb7-9fb9-184bd3d4ca00 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:51.633788 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff5fa9-45a0-437c-8757-0222dfa95176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:51.634421 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff5fa9-45a0-437c-8757-0222dfa95176 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:51.634698 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff5fa9-45a0-437c-8757-0222dfa95176 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:51.635561 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff5fa9-45a0-437c-8757-0222dfa95176 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:51.646349 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff5fa9-45a0-437c-8757-0222dfa95176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:51.647790 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff5fa9-45a0-437c-8757-0222dfa95176 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:51.662973 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-73ff5fa9-45a0-437c-8757-0222dfa95176 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:51.662973 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:51.662973 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:51.662973 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:51.662973 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:51.662973 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:51.662973 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:51.662973 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:51.662973 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:51.662973 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:51.662973 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:51.662973 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:51.662973 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:51.662973 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:51.662973 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:51.662973 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:51.664771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:51.664771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:51.664771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:51.664771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:51.664771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:51.664771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:51.664771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:51.664771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:51.664771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:51.664771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:51.664771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:51.664771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:51.664771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:51.664771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:51.664771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:51.664771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:51.664771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:51.666504 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:51.666504 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:51.666504 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:08:51.666504 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 434/890] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:51.670015 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff912b5-775d-46c1-915b-831466b71828 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:51.771959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff912b5-775d-46c1-915b-831466b71828 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:51.808529 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bea399-d3ef-46eb-87c9-e0b49ee4c6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:51.809168 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bea399-d3ef-46eb-87c9-e0b49ee4c6c1 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:51.809488 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bea399-d3ef-46eb-87c9-e0b49ee4c6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:51.809761 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bea399-d3ef-46eb-87c9-e0b49ee4c6c1 None admin] PATH_INFO: `/v3/domains` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:51.810432 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bea399-d3ef-46eb-87c9-e0b49ee4c6c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:51.810736 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bea399-d3ef-46eb-87c9-e0b49ee4c6c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:51.812202 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bea399-d3ef-46eb-87c9-e0b49ee4c6c1 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:51.825640 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 457/891] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:51.831400 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff5fa9-45a0-437c-8757-0222dfa95176 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:51.866706 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:51.939714 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff5fa9-45a0-437c-8757-0222dfa95176 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:51.975250 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b519b9c-2d24-450f-8ce6-77a2691b7beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:51.975893 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b519b9c-2d24-450f-8ce6-77a2691b7beb None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:51.976176 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b519b9c-2d24-450f-8ce6-77a2691b7beb None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:51.976449 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b519b9c-2d24-450f-8ce6-77a2691b7beb None admin] PATH_INFO: `/v3/projects/service` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:51.983904 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b519b9c-2d24-450f-8ce6-77a2691b7beb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:51.985376 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b519b9c-2d24-450f-8ce6-77a2691b7beb None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:51.998105 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-2b519b9c-2d24-450f-8ce6-77a2691b7beb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:51.998105 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:51.998105 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:51.998105 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:51.998105 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:51.998105 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:51.998105 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:51.998105 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:51.998105 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:51.998105 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:51.998105 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:51.998105 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:51.998105 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:08:51.998105 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:08:51.998105 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:08:51.999229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:08:51.999229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:51.999229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:51.999229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:51.999229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:51.999229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:51.999229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:51.999229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:51.999229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:51.999229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:51.999229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:51.999229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:51.999229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:51.999229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:51.999229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:51.999229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:51.999229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:52.000151 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:08:52.000151 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:08:52.000151 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:08:52.000151 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:08:52.000151 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:08:52.000151 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:08:52.000151 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:52.000151 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:08:52.000151 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 435/892] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:08:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:52.011373 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bea399-d3ef-46eb-87c9-e0b49ee4c6c1 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:52.070370 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:52.115756 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bea399-d3ef-46eb-87c9-e0b49ee4c6c1 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:52.149872 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab9a99-7011-4ccc-88e3-f3460c36148a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:52.150478 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab9a99-7011-4ccc-88e3-f3460c36148a None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:52.150754 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab9a99-7011-4ccc-88e3-f3460c36148a None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:52.151024 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab9a99-7011-4ccc-88e3-f3460c36148a None admin] PATH_INFO: `/v3/projects` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:52.151739 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab9a99-7011-4ccc-88e3-f3460c36148a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:52.152010 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab9a99-7011-4ccc-88e3-f3460c36148a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:52.153464 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab9a99-7011-4ccc-88e3-f3460c36148a None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:52.166102 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 458/893] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 9 11:08:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:52.172989 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b519b9c-2d24-450f-8ce6-77a2691b7beb None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:52.264257 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:52.275045 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b519b9c-2d24-450f-8ce6-77a2691b7beb None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:52.312333 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e388fb-a52c-45d5-8b3c-87021650c0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:52.313101 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e388fb-a52c-45d5-8b3c-87021650c0fc None admin] REQUEST_METHOD: `PUT` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:52.313378 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e388fb-a52c-45d5-8b3c-87021650c0fc None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:52.313652 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e388fb-a52c-45d5-8b3c-87021650c0fc None admin] PATH_INFO: `/v3/projects/b9cec15abcd74e13ba458c64ad6fdf9b/users/ff72ca8bbc74499bb18ad4cb3ae2024c/roles/b02ba8c157bf46f4a75cdab917db78db` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:52.315614 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e388fb-a52c-45d5-8b3c-87021650c0fc None admin] RBAC: Authorizing `identity:create_grant(project_id=b9cec15abcd74e13ba458c64ad6fdf9b, user_id=ff72ca8bbc74499bb18ad4cb3ae2024c, role_id=b02ba8c157bf46f4a75cdab917db78db)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:52.317066 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e388fb-a52c-45d5-8b3c-87021650c0fc None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:52.331019 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 436/894] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 9 11:08:52 2022] PUT /identity/v3/projects/b9cec15abcd74e13ba458c64ad6fdf9b/users/ff72ca8bbc74499bb18ad4cb3ae2024c/roles/b02ba8c157bf46f4a75cdab917db78db => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:08:54.787137 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f51c37-74f8-473f-844b-5969abe41eee None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:54.787661 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f51c37-74f8-473f-844b-5969abe41eee None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:54.787661 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f51c37-74f8-473f-844b-5969abe41eee None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:54.789006 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 459/895] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:54.794700 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea079bdb-3025-42d4-baa4-3f5c252dbdfa None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:54.795132 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea079bdb-3025-42d4-baa4-3f5c252dbdfa None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:54.795225 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea079bdb-3025-42d4-baa4-3f5c252dbdfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:54.815456 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-ea079bdb-3025-42d4-baa4-3f5c252dbdfa None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:54.817206 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-ea079bdb-3025-42d4-baa4-3f5c252dbdfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:54.897936 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 437/896] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:54 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:08:55.238664 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f51c37-74f8-473f-844b-5969abe41eee None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:55.341308 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f51c37-74f8-473f-844b-5969abe41eee None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:55.355458 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:55.375868 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a695ffe-755f-4634-b5fb-871c5f84ead6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:55.376521 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a695ffe-755f-4634-b5fb-871c5f84ead6 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:55.376803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a695ffe-755f-4634-b5fb-871c5f84ead6 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:55.377076 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a695ffe-755f-4634-b5fb-871c5f84ead6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:55.389709 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a695ffe-755f-4634-b5fb-871c5f84ead6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:55.396845 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-8a695ffe-755f-4634-b5fb-871c5f84ead6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:08:55.396845 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:55.396845 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:55.396845 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:55.396845 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:55.396845 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:55.396845 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:55.396845 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:55.396845 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:55.396845 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:55.396845 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:55.396845 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:55.396845 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:55.396845 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:55.396845 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:55.396845 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:55.398005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:55.398005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:55.398005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:55.398005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:55.398005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:55.398005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:55.398005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:55.398005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:55.398005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:55.398005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:55.398005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:55.398005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:55.398005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:55.398005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:55.398005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:55.398005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:55.398896 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:55.398896 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:55.398896 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:55.398896 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:55.398896 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:55.398896 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:55.398896 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:55.398896 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:55.398896 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:55.398896 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:55.398896 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:08:55.398896 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:08:55.398896 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 460/897] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 9 11:08:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:55.405316 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea079bdb-3025-42d4-baa4-3f5c252dbdfa None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:55.489310 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:55.508747 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea079bdb-3025-42d4-baa4-3f5c252dbdfa None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:55.544342 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81529fcf-ba44-4626-b406-d3e3c8885409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:55.544952 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81529fcf-ba44-4626-b406-d3e3c8885409 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:55.545233 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81529fcf-ba44-4626-b406-d3e3c8885409 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:55.545540 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81529fcf-ba44-4626-b406-d3e3c8885409 None admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:55.546203 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81529fcf-ba44-4626-b406-d3e3c8885409 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:55.546506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81529fcf-ba44-4626-b406-d3e3c8885409 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:55.548133 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81529fcf-ba44-4626-b406-d3e3c8885409 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:55.556318 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 438/898] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 9 11:08:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:55.562873 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a695ffe-755f-4634-b5fb-871c5f84ead6 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:55.676281 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a695ffe-755f-4634-b5fb-871c5f84ead6 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:55.713227 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bab38-2c6e-42af-9036-ec1e9f8f9245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:55.713893 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bab38-2c6e-42af-9036-ec1e9f8f9245 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:55.714169 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bab38-2c6e-42af-9036-ec1e9f8f9245 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:55.714442 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bab38-2c6e-42af-9036-ec1e9f8f9245 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:55.728106 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bab38-2c6e-42af-9036-ec1e9f8f9245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:55.729841 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bab38-2c6e-42af-9036-ec1e9f8f9245 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:55.749760 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-971bab38-2c6e-42af-9036-ec1e9f8f9245 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:55.749760 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:55.749760 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:55.749760 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:55.749760 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:55.749760 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:55.749760 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:55.749760 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:55.749760 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:55.749760 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:55.749760 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:55.749760 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:55.749760 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:55.749760 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:55.749760 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:55.749760 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:55.751041 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:55.751041 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:55.751041 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:55.751041 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:55.751041 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:55.751041 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:55.751041 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:55.751041 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:55.751041 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:55.751041 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:55.751041 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:55.751041 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:55.751041 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:55.751041 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:55.751041 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:55.751041 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:55.751041 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:55.752280 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:55.752280 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:55.752280 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:08:55.752280 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 461/899] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:55.757594 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81529fcf-ba44-4626-b406-d3e3c8885409 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:55.883222 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81529fcf-ba44-4626-b406-d3e3c8885409 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:55.929253 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361dccd0-789c-47c2-bf0b-95f3f66a4282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:55.929900 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dccd0-789c-47c2-bf0b-95f3f66a4282 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:55.930171 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dccd0-789c-47c2-bf0b-95f3f66a4282 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:55.930433 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dccd0-789c-47c2-bf0b-95f3f66a4282 None admin] PATH_INFO: `/v3/domains` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:55.931080 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361dccd0-789c-47c2-bf0b-95f3f66a4282 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:55.931382 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361dccd0-789c-47c2-bf0b-95f3f66a4282 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:55.932771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361dccd0-789c-47c2-bf0b-95f3f66a4282 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:55.945156 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 439/900] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:55.951915 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bab38-2c6e-42af-9036-ec1e9f8f9245 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:55.984554 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:56.075066 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bab38-2c6e-42af-9036-ec1e9f8f9245 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:56.117372 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf671a7-f1da-41d5-a7a5-7ebf75bda42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:56.118071 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf671a7-f1da-41d5-a7a5-7ebf75bda42a None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:56.118305 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf671a7-f1da-41d5-a7a5-7ebf75bda42a None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:56.118575 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf671a7-f1da-41d5-a7a5-7ebf75bda42a None admin] PATH_INFO: `/v3/users/placement` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:56.127456 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf671a7-f1da-41d5-a7a5-7ebf75bda42a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:56.128884 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf671a7-f1da-41d5-a7a5-7ebf75bda42a None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:56.140103 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-bdf671a7-f1da-41d5-a7a5-7ebf75bda42a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:08:56.140103 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:56.140103 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:56.140103 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:56.140103 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:56.140103 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:56.140103 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:56.140103 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:56.140103 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:56.140103 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:56.140103 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:56.140103 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:56.140103 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:08:56.140103 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:08:56.140103 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:08:56.140103 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:08:56.141112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:56.141112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:56.141112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:08:56.141112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:56.141112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:08:56.141112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:56.141112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:56.141112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:56.141112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:56.141112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:56.141112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:56.141112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:56.141112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:56.141112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:56.141112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:56.141112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:56.141112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:56.141112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:56.142216 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:56.142216 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:56.142216 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:08:56.142216 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:08:56.142216 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:08:56.142216 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:08:56.142216 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:08:56.142216 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:08:56.142216 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:08:56.142216 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:08:56.142216 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 462/901] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:08:56.147654 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361dccd0-789c-47c2-bf0b-95f3f66a4282 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:56.152242 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:56.250915 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361dccd0-789c-47c2-bf0b-95f3f66a4282 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:56.288088 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d4ad2-c91e-4568-8e46-512df71db79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:56.288682 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d4ad2-c91e-4568-8e46-512df71db79b None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:56.288961 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d4ad2-c91e-4568-8e46-512df71db79b None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:56.289222 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d4ad2-c91e-4568-8e46-512df71db79b None admin] PATH_INFO: `/v3/users` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:56.289967 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d4ad2-c91e-4568-8e46-512df71db79b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:56.290258 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d4ad2-c91e-4568-8e46-512df71db79b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:56.292269 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d4ad2-c91e-4568-8e46-512df71db79b None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:56.313261 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 440/902] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Sep 9 11:08:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:56.320134 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf671a7-f1da-41d5-a7a5-7ebf75bda42a None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:56.425469 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:56.441769 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf671a7-f1da-41d5-a7a5-7ebf75bda42a None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:56.486100 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12676eb2-32fb-49c9-8943-0b081b44b72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:56.487032 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12676eb2-32fb-49c9-8943-0b081b44b72d None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:56.487481 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12676eb2-32fb-49c9-8943-0b081b44b72d None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:56.487853 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12676eb2-32fb-49c9-8943-0b081b44b72d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:56.571489 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12676eb2-32fb-49c9-8943-0b081b44b72d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:56.573845 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12676eb2-32fb-49c9-8943-0b081b44b72d None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:56.664426 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:56.681518 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 463/903] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 9 11:08:56 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:08:56.687698 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d4ad2-c91e-4568-8e46-512df71db79b None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:56.764166 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:56.810669 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d4ad2-c91e-4568-8e46-512df71db79b None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:56.850011 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e227f0-a924-4ce4-b5cb-b7fa67e13176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:56.850654 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e227f0-a924-4ce4-b5cb-b7fa67e13176 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:56.850933 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e227f0-a924-4ce4-b5cb-b7fa67e13176 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:56.851206 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e227f0-a924-4ce4-b5cb-b7fa67e13176 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:56.861690 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e227f0-a924-4ce4-b5cb-b7fa67e13176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:56.863199 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e227f0-a924-4ce4-b5cb-b7fa67e13176 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:56.878779 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-47e227f0-a924-4ce4-b5cb-b7fa67e13176 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:56.878779 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:56.878779 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:56.878779 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:56.878779 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:56.878779 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:56.878779 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:56.878779 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:56.878779 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:56.878779 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:56.878779 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:56.878779 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:56.878779 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:56.878779 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:56.878779 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:56.878779 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:56.880023 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:56.880023 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:56.880023 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:56.880023 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:56.880023 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:56.880023 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:56.880023 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:56.880023 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:56.880023 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:56.880023 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:56.880023 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:56.880023 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:56.880023 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:56.880023 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:56.880023 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:56.880023 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:56.880023 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:56.880955 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:56.880955 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:56.880955 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:08:56.880955 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 441/904] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:56.886392 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12676eb2-32fb-49c9-8943-0b081b44b72d None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:56.993184 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12676eb2-32fb-49c9-8943-0b081b44b72d None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:57.030555 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407f9c6-cdf1-4d72-92e4-c9fecbc82600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:57.031156 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407f9c6-cdf1-4d72-92e4-c9fecbc82600 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:57.031426 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407f9c6-cdf1-4d72-92e4-c9fecbc82600 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:57.031696 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407f9c6-cdf1-4d72-92e4-c9fecbc82600 None admin] PATH_INFO: `/v3/domains` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:57.032324 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407f9c6-cdf1-4d72-92e4-c9fecbc82600 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:57.032616 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407f9c6-cdf1-4d72-92e4-c9fecbc82600 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:57.033985 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407f9c6-cdf1-4d72-92e4-c9fecbc82600 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:57.055980 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 464/905] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:57.066414 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e227f0-a924-4ce4-b5cb-b7fa67e13176 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:57.208359 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e227f0-a924-4ce4-b5cb-b7fa67e13176 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:57.223680 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:57.246611 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39413209-bba5-46f0-bf73-67a9dabdbf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:57.247152 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39413209-bba5-46f0-bf73-67a9dabdbf87 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:57.247432 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39413209-bba5-46f0-bf73-67a9dabdbf87 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:57.247707 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39413209-bba5-46f0-bf73-67a9dabdbf87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:57.254969 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39413209-bba5-46f0-bf73-67a9dabdbf87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:57.257443 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39413209-bba5-46f0-bf73-67a9dabdbf87 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:57.269771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application [None req-39413209-bba5-46f0-bf73-67a9dabdbf87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:57.269771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:57.269771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:57.269771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:57.269771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:57.269771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:57.269771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:57.269771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:57.269771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:57.269771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:57.269771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:57.269771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:57.269771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:08:57.269771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:08:57.269771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:08:57.271117 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:08:57.271117 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:57.271117 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:57.271117 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:57.271117 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:57.271117 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:57.271117 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:57.271117 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:57.271117 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:57.271117 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:57.271117 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:57.271117 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:57.271117 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:57.271117 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:57.271117 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:57.271117 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:57.271117 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:57.272229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:08:57.272229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:08:57.272229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:08:57.272229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:08:57.272229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:08:57.272229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:08:57.272229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:57.272229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: ERROR keystone.server.flask.application Sep 09 11:08:57.272229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 442/906] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 9 11:08:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:57.276831 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407f9c6-cdf1-4d72-92e4-c9fecbc82600 None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:57.330984 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:57.389366 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407f9c6-cdf1-4d72-92e4-c9fecbc82600 None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:57.422950 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f3303-de1b-4396-8057-cb79f183e32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:57.423552 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f3303-de1b-4396-8057-cb79f183e32b None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:57.423829 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f3303-de1b-4396-8057-cb79f183e32b None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:57.424093 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f3303-de1b-4396-8057-cb79f183e32b None admin] PATH_INFO: `/v3/projects` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:57.424768 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f3303-de1b-4396-8057-cb79f183e32b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:57.425066 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f3303-de1b-4396-8057-cb79f183e32b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:57.426524 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f3303-de1b-4396-8057-cb79f183e32b None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:57.439075 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 465/907] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 9 11:08:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:57.445788 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39413209-bba5-46f0-bf73-67a9dabdbf87 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:57.559710 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39413209-bba5-46f0-bf73-67a9dabdbf87 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:57.596158 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e65a36-e90f-4175-9480-fc2231d050fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:57.596765 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e65a36-e90f-4175-9480-fc2231d050fe None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:57.597099 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e65a36-e90f-4175-9480-fc2231d050fe None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:57.597443 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e65a36-e90f-4175-9480-fc2231d050fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:57.598336 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e65a36-e90f-4175-9480-fc2231d050fe None admin] RBAC: Adding query filter params (role.id=b02ba8c157bf46f4a75cdab917db78db, scope.project.id=b9cec15abcd74e13ba458c64ad6fdf9b, user.id=ff72ca8bbc74499bb18ad4cb3ae2024c) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:57.598649 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e65a36-e90f-4175-9480-fc2231d050fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:57.600077 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e65a36-e90f-4175-9480-fc2231d050fe None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:57.606701 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 443/908] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 9 11:08:57 2022] GET /identity/v3/role_assignments?user.id=ff72ca8bbc74499bb18ad4cb3ae2024c&scope.project.id=b9cec15abcd74e13ba458c64ad6fdf9b&role.id=b02ba8c157bf46f4a75cdab917db78db => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:09:00.070245 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b36dbd-c982-43a3-8e16-662d56947993 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:00.070903 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b36dbd-c982-43a3-8e16-662d56947993 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:00.070903 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b36dbd-c982-43a3-8e16-662d56947993 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:00.072359 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 466/909] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:09:00.078261 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a352df3-6540-4d05-a705-7eb2fff38ec5 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:00.078671 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a352df3-6540-4d05-a705-7eb2fff38ec5 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:00.078810 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a352df3-6540-4d05-a705-7eb2fff38ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:00.097000 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-6a352df3-6540-4d05-a705-7eb2fff38ec5 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:09:00.098220 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-6a352df3-6540-4d05-a705-7eb2fff38ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:09:00.127627 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:00.165038 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 444/910] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:09:00 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:09:00.491631 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b36dbd-c982-43a3-8e16-662d56947993 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:00.597080 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b36dbd-c982-43a3-8e16-662d56947993 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:00.605193 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:00.633500 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cc1e7-82c0-40a1-b9ad-008e443ca15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:00.634118 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cc1e7-82c0-40a1-b9ad-008e443ca15c None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:00.634395 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cc1e7-82c0-40a1-b9ad-008e443ca15c None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:00.634663 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cc1e7-82c0-40a1-b9ad-008e443ca15c None admin] PATH_INFO: `/v3/services/placement` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:00.635251 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77cc1e7-82c0-40a1-b9ad-008e443ca15c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:00.637028 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77cc1e7-82c0-40a1-b9ad-008e443ca15c None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:00.645693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-c77cc1e7-82c0-40a1-b9ad-008e443ca15c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 11:09:00.645693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:00.645693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:09:00.645693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:09:00.645693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:09:00.645693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:09:00.645693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:09:00.645693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:00.645693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 11:09:00.645693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:09:00.645693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:09:00.645693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:09:00.645693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:00.645693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:00.645693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:00.645693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:00.645693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:00.646964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:00.646964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:00.646964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:00.646964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:00.646964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:00.646964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:00.646964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:09:00.646964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:09:00.646964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:09:00.646964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:09:00.646964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:00.646964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:00.646964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:09:00.646964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:09:00.646964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:09:00.646964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:09:00.648033 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:09:00.648033 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:09:00.648033 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:09:00.648033 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:09:00.648033 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:09:00.648033 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:09:00.648033 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:09:00.648033 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:09:00.648033 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:09:00.648033 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:09:00.648033 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:09:00.648033 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:00.648033 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 11:09:00.648033 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:09:00.648033 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 467/911] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 9 11:09:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:09:00.653323 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a352df3-6540-4d05-a705-7eb2fff38ec5 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:00.748064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a352df3-6540-4d05-a705-7eb2fff38ec5 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:00.779989 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49a575-a4c6-41e4-af97-fbdca35b5c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:00.780576 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49a575-a4c6-41e4-af97-fbdca35b5c6d None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:00.780849 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49a575-a4c6-41e4-af97-fbdca35b5c6d None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:00.781114 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49a575-a4c6-41e4-af97-fbdca35b5c6d None admin] PATH_INFO: `/v3/services` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:00.781755 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49a575-a4c6-41e4-af97-fbdca35b5c6d None admin] RBAC: Adding query filter params (name=placement) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:00.782051 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49a575-a4c6-41e4-af97-fbdca35b5c6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:00.783397 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49a575-a4c6-41e4-af97-fbdca35b5c6d None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:00.787913 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 445/912] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Sep 9 11:09:00 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:00.794316 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cc1e7-82c0-40a1-b9ad-008e443ca15c None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:00.901993 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cc1e7-82c0-40a1-b9ad-008e443ca15c None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:00.938876 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd132b-a776-40a0-9ce1-3f393ecf5524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:00.939476 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd132b-a776-40a0-9ce1-3f393ecf5524 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:00.939754 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd132b-a776-40a0-9ce1-3f393ecf5524 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:00.940027 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd132b-a776-40a0-9ce1-3f393ecf5524 None admin] PATH_INFO: `/v3/services` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:00.940656 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd132b-a776-40a0-9ce1-3f393ecf5524 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:00.940955 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd132b-a776-40a0-9ce1-3f393ecf5524 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:00.942347 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd132b-a776-40a0-9ce1-3f393ecf5524 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:00.946760 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 468/913] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Sep 9 11:09:00 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:03.364225 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c955d-562b-4794-bfce-e11661821295 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:03.364789 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c955d-562b-4794-bfce-e11661821295 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:03.364789 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c955d-562b-4794-bfce-e11661821295 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:03.366127 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 446/914] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:09:03.371884 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969512cd-52ce-4e54-b64b-20dc3d5753d5 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:03.372316 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969512cd-52ce-4e54-b64b-20dc3d5753d5 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:03.372413 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969512cd-52ce-4e54-b64b-20dc3d5753d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:03.392884 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-969512cd-52ce-4e54-b64b-20dc3d5753d5 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:09:03.394149 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-969512cd-52ce-4e54-b64b-20dc3d5753d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:09:03.424788 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:03.464752 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 469/915] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:09:03 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:09:03.787147 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c955d-562b-4794-bfce-e11661821295 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:03.820998 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:03.892150 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c955d-562b-4794-bfce-e11661821295 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:03.926529 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44b57d-5c7f-4aa3-a345-66be7b4266ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:03.926827 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44b57d-5c7f-4aa3-a345-66be7b4266ae None admin] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:03.927028 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44b57d-5c7f-4aa3-a345-66be7b4266ae None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:03.927313 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44b57d-5c7f-4aa3-a345-66be7b4266ae None admin] PATH_INFO: `/v3/services` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:03.927969 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44b57d-5c7f-4aa3-a345-66be7b4266ae None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:03.929355 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44b57d-5c7f-4aa3-a345-66be7b4266ae None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:03.944375 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 447/916] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 9 11:09:03 2022] POST /identity/v3/services => generated 246 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:09:06.381651 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ab196-258d-44ae-9279-be5f252deb5c None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:06.382177 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ab196-258d-44ae-9279-be5f252deb5c None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:06.382177 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ab196-258d-44ae-9279-be5f252deb5c None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:06.383531 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 470/917] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:09:06.388896 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939bf6fa-4384-45b0-b821-11a9057d190c None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:06.389363 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939bf6fa-4384-45b0-b821-11a9057d190c None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:06.389467 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939bf6fa-4384-45b0-b821-11a9057d190c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:06.407177 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-939bf6fa-4384-45b0-b821-11a9057d190c None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:09:06.408342 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-939bf6fa-4384-45b0-b821-11a9057d190c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:09:06.486260 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 448/918] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:09:06 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:09:06.824894 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ab196-258d-44ae-9279-be5f252deb5c None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:06.935485 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ab196-258d-44ae-9279-be5f252deb5c None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:06.968181 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474af40-fbab-40f3-95f6-e690c11e469d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:06.968797 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474af40-fbab-40f3-95f6-e690c11e469d None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:06.969069 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474af40-fbab-40f3-95f6-e690c11e469d None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:06.969369 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474af40-fbab-40f3-95f6-e690c11e469d None admin] PATH_INFO: `/v3/services/placement` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:06.969943 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474af40-fbab-40f3-95f6-e690c11e469d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:06.971314 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474af40-fbab-40f3-95f6-e690c11e469d None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:06.980426 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-4474af40-fbab-40f3-95f6-e690c11e469d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 11:09:06.980426 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:06.980426 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:09:06.980426 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:09:06.980426 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:09:06.980426 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:09:06.980426 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:09:06.980426 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:06.980426 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 11:09:06.980426 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:09:06.980426 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:09:06.980426 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:09:06.980426 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:06.980426 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:06.980426 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:06.980426 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:06.980426 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:06.981602 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:06.981602 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:06.981602 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:06.981602 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:06.981602 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:06.981602 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:06.981602 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:09:06.981602 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:09:06.981602 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:09:06.981602 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:09:06.981602 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:06.981602 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:06.981602 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:09:06.981602 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:09:06.981602 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:09:06.981602 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:09:06.982871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:09:06.982871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:09:06.982871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:09:06.982871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:09:06.982871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:09:06.982871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:09:06.982871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:09:06.982871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:09:06.982871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:09:06.982871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:09:06.982871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:09:06.982871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:06.982871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 11:09:06.982871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:09:06.982871 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 471/919] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 9 11:09:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:09:06.987455 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939bf6fa-4384-45b0-b821-11a9057d190c None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:07.005103 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:07.084202 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939bf6fa-4384-45b0-b821-11a9057d190c None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:07.121501 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e47e65-e086-487d-8527-e583facb3ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:07.122425 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e47e65-e086-487d-8527-e583facb3ea2 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:07.122871 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e47e65-e086-487d-8527-e583facb3ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:07.123343 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e47e65-e086-487d-8527-e583facb3ea2 None admin] PATH_INFO: `/v3/services` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:07.123986 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e47e65-e086-487d-8527-e583facb3ea2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:07.124280 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e47e65-e086-487d-8527-e583facb3ea2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:07.125681 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e47e65-e086-487d-8527-e583facb3ea2 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:07.131316 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 449/920] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Sep 9 11:09:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:07.138187 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474af40-fbab-40f3-95f6-e690c11e469d None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:07.167804 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:07.243372 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474af40-fbab-40f3-95f6-e690c11e469d None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:07.279812 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cad5c-61f1-484f-a385-d8d0a2aceb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:07.280427 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cad5c-61f1-484f-a385-d8d0a2aceb16 None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:07.280711 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cad5c-61f1-484f-a385-d8d0a2aceb16 None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:07.280986 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cad5c-61f1-484f-a385-d8d0a2aceb16 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:07.281726 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334cad5c-61f1-484f-a385-d8d0a2aceb16 None admin] RBAC: Adding query filter params (interface=public, service_id=351741c082784127a182e4ddc60384dd, region_id=RegionOne) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:07.282037 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334cad5c-61f1-484f-a385-d8d0a2aceb16 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:07.283419 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334cad5c-61f1-484f-a385-d8d0a2aceb16 None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:07.288991 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 472/921] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Sep 9 11:09:07 2022] GET /identity/v3/endpoints?service_id=351741c082784127a182e4ddc60384dd&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:09:07.296144 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e47e65-e086-487d-8527-e583facb3ea2 None admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:07.378455 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:07.396267 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e47e65-e086-487d-8527-e583facb3ea2 None admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:07.432533 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef109c4e-ad8c-4a6b-b56d-4ed26bf15909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:07.433149 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef109c4e-ad8c-4a6b-b56d-4ed26bf15909 None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:07.433467 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef109c4e-ad8c-4a6b-b56d-4ed26bf15909 None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:07.433745 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef109c4e-ad8c-4a6b-b56d-4ed26bf15909 None admin] PATH_INFO: `/v3/services` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:07.434365 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef109c4e-ad8c-4a6b-b56d-4ed26bf15909 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:07.435746 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef109c4e-ad8c-4a6b-b56d-4ed26bf15909 None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:07.442685 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 450/922] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 9 11:09:07 2022] GET /identity/v3/services => generated 1962 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:09:09.867548 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbdc22-d889-4dc0-ae51-8fc40c9ac4eb None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:09.868156 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbdc22-d889-4dc0-ae51-8fc40c9ac4eb None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:09.868156 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbdc22-d889-4dc0-ae51-8fc40c9ac4eb None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:09.869774 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 473/923] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:09:09.876977 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1aaa7c-76ce-40b6-aae7-6b8c1e0a2db3 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:09.877496 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1aaa7c-76ce-40b6-aae7-6b8c1e0a2db3 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:09.877623 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1aaa7c-76ce-40b6-aae7-6b8c1e0a2db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:09.896046 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-ce1aaa7c-76ce-40b6-aae7-6b8c1e0a2db3 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:09:09.897246 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-ce1aaa7c-76ce-40b6-aae7-6b8c1e0a2db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:09:09.964711 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 451/924] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:09:09 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:09:10.288605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbdc22-d889-4dc0-ae51-8fc40c9ac4eb None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:10.379955 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:10.390150 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbdc22-d889-4dc0-ae51-8fc40c9ac4eb None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:10.423045 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f104e3-0bc4-458d-aed9-12a785d9d9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:10.423925 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f104e3-0bc4-458d-aed9-12a785d9d9cc None admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:10.424203 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f104e3-0bc4-458d-aed9-12a785d9d9cc None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:10.424476 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f104e3-0bc4-458d-aed9-12a785d9d9cc None admin] PATH_INFO: `/v3/services/placement` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:10.425059 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f104e3-0bc4-458d-aed9-12a785d9d9cc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:10.426453 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f104e3-0bc4-458d-aed9-12a785d9d9cc None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:10.435723 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application [None req-c3f104e3-0bc4-458d-aed9-12a785d9d9cc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 11:09:10.435723 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:10.435723 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:09:10.435723 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:09:10.435723 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:09:10.435723 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:09:10.435723 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:09:10.435723 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:10.435723 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 11:09:10.435723 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:09:10.435723 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:09:10.435723 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:09:10.435723 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:10.435723 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:10.435723 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:10.435723 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:10.435723 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:10.436869 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:10.436869 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:10.436869 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:10.436869 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:10.436869 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:10.436869 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:10.436869 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:09:10.436869 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:09:10.436869 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:09:10.436869 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:09:10.436869 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:10.436869 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:10.436869 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:09:10.436869 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:09:10.436869 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:09:10.436869 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:09:10.438160 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:09:10.438160 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application with Lock( Sep 09 11:09:10.438160 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:09:10.438160 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:09:10.438160 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:09:10.438160 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:09:10.438160 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:09:10.438160 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:09:10.438160 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:09:10.438160 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:09:10.438160 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:09:10.438160 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:10.438160 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 11:09:10.438160 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: ERROR keystone.server.flask.application Sep 09 11:09:10.438160 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 474/925] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 9 11:09:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:09:10.442828 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1aaa7c-76ce-40b6-aae7-6b8c1e0a2db3 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:10.527578 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:10.549792 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1aaa7c-76ce-40b6-aae7-6b8c1e0a2db3 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:10.582775 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba8071-a166-4197-94b1-145bbe8f29eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:10.583372 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba8071-a166-4197-94b1-145bbe8f29eb None admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:10.583649 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba8071-a166-4197-94b1-145bbe8f29eb None admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:10.583913 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba8071-a166-4197-94b1-145bbe8f29eb None admin] PATH_INFO: `/v3/services` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:10.584533 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba8071-a166-4197-94b1-145bbe8f29eb None admin] RBAC: Adding query filter params (name=placement) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:10.584829 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba8071-a166-4197-94b1-145bbe8f29eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:10.586213 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba8071-a166-4197-94b1-145bbe8f29eb None admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:10.591060 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 452/926] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Sep 9 11:09:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:10.596799 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f104e3-0bc4-458d-aed9-12a785d9d9cc None admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:10.695789 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f104e3-0bc4-458d-aed9-12a785d9d9cc None admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:10.729214 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b25aa-9adf-464c-9942-5dfea64a1bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:10.729858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b25aa-9adf-464c-9942-5dfea64a1bea None admin] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:10.730139 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b25aa-9adf-464c-9942-5dfea64a1bea None admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:10.730410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b25aa-9adf-464c-9942-5dfea64a1bea None admin] PATH_INFO: `/v3/endpoints` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:10.731075 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b25aa-9adf-464c-9942-5dfea64a1bea None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:10.732426 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b25aa-9adf-464c-9942-5dfea64a1bea None admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:10.753313 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 475/927] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 9 11:09:10 2022] POST /identity/v3/endpoints => generated 331 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:09:20.588320 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=30 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:20.748273 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:10:16.376990 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6095d7e-93af-492c-afde-0db4b32225c5 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:16.377618 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6095d7e-93af-492c-afde-0db4b32225c5 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:16.377618 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6095d7e-93af-492c-afde-0db4b32225c5 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:16.379126 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 453/928] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:10:16.384765 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0825f-e3d2-4615-842e-4c755210fb03 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:16.385268 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0825f-e3d2-4615-842e-4c755210fb03 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:16.385528 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0825f-e3d2-4615-842e-4c755210fb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:16.406831 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-36a0825f-e3d2-4615-842e-4c755210fb03 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:10:16.408107 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-36a0825f-e3d2-4615-842e-4c755210fb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:10:16.489092 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 476/929] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:10:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:10:16.905048 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877964db-187c-4936-9f77-b8a8f5499cb1 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:16.906360 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877964db-187c-4936-9f77-b8a8f5499cb1 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:16.906814 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877964db-187c-4936-9f77-b8a8f5499cb1 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:16.908674 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 454/930] 10.222.0.20 () {54 vars in 965 bytes} [Fri Sep 9 11:10:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:10:16.916752 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf28793-d744-45a5-ae93-8e228cfd914a None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:16.917353 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf28793-d744-45a5-ae93-8e228cfd914a None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:16.917827 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf28793-d744-45a5-ae93-8e228cfd914a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:17.067835 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-5cf28793-d744-45a5-ae93-8e228cfd914a None None] MFA Rules not processed for user `1693fd5ca6084609adcb148aa7d7a8d6`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:10:17.070674 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-5cf28793-d744-45a5-ae93-8e228cfd914a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:10:17.253781 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877964db-187c-4936-9f77-b8a8f5499cb1 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:17.256165 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 477/931] 10.222.0.20 () {58 vars in 1062 bytes} [Fri Sep 9 11:10:16 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:10:17.269738 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877964db-187c-4936-9f77-b8a8f5499cb1 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:17.281677 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14addf40-904b-4aa8-a77c-6b0e07bc29ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:17.282314 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14addf40-904b-4aa8-a77c-6b0e07bc29ad service neutron] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:17.282595 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14addf40-904b-4aa8-a77c-6b0e07bc29ad service neutron] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:17.286138 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14addf40-904b-4aa8-a77c-6b0e07bc29ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:17.327746 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14addf40-904b-4aa8-a77c-6b0e07bc29ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:17.329721 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14addf40-904b-4aa8-a77c-6b0e07bc29ad service neutron] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:17.368998 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 455/932] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:10:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:10:20.246160 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124e576-3c22-40bc-88c9-836cc18a9fef None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:20.246980 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124e576-3c22-40bc-88c9-836cc18a9fef None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:20.246980 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124e576-3c22-40bc-88c9-836cc18a9fef None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:20.248827 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 478/933] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:10:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:10:20.255124 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dff957-1db7-4f5e-87d0-3e1e31086818 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:20.255958 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dff957-1db7-4f5e-87d0-3e1e31086818 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:20.255958 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dff957-1db7-4f5e-87d0-3e1e31086818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:20.277955 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-82dff957-1db7-4f5e-87d0-3e1e31086818 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:10:20.279242 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-82dff957-1db7-4f5e-87d0-3e1e31086818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:10:20.287670 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 456/934] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:10:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:10:20.654912 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c89a36-90d2-40eb-83e1-bb092977b3b1 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:20.655200 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c89a36-90d2-40eb-83e1-bb092977b3b1 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:20.655451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c89a36-90d2-40eb-83e1-bb092977b3b1 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:20.656854 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 479/935] 10.222.0.20 () {54 vars in 965 bytes} [Fri Sep 9 11:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:10:20.666092 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e6d33-cab3-4af4-b17a-05fc90b853de None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:20.666447 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e6d33-cab3-4af4-b17a-05fc90b853de None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:20.666783 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e6d33-cab3-4af4-b17a-05fc90b853de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:20.689735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-296e6d33-cab3-4af4-b17a-05fc90b853de None None] MFA Rules not processed for user `1693fd5ca6084609adcb148aa7d7a8d6`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:10:20.691083 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-296e6d33-cab3-4af4-b17a-05fc90b853de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:10:20.698194 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 457/936] 10.222.0.20 () {58 vars in 1062 bytes} [Fri Sep 9 11:10:20 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:10:20.708277 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c89a36-90d2-40eb-83e1-bb092977b3b1 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:20.720211 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c89a36-90d2-40eb-83e1-bb092977b3b1 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:20.724163 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894ef3b-5456-42f7-a732-cbd317fe7456 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:20.724903 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894ef3b-5456-42f7-a732-cbd317fe7456 service neutron] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:20.725315 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894ef3b-5456-42f7-a732-cbd317fe7456 service neutron] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:20.725741 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894ef3b-5456-42f7-a732-cbd317fe7456 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:20.736497 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894ef3b-5456-42f7-a732-cbd317fe7456 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:20.738225 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894ef3b-5456-42f7-a732-cbd317fe7456 service neutron] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:20.750801 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 480/937] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:10:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:10:23.843453 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533b2d4-9856-4ea3-9f72-89f652dbae06 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:23.844553 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533b2d4-9856-4ea3-9f72-89f652dbae06 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:23.844883 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533b2d4-9856-4ea3-9f72-89f652dbae06 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:23.846708 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 458/938] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:10:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:10:23.852422 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d1140-f5ed-4884-ac42-54ea7cfe0535 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:23.853254 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d1140-f5ed-4884-ac42-54ea7cfe0535 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:23.853254 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d1140-f5ed-4884-ac42-54ea7cfe0535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:23.899296 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-247d1140-f5ed-4884-ac42-54ea7cfe0535 None None] MFA Rules not processed for user `ffaf170d5bc6440caacc8723c5238029`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:10:23.900515 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-247d1140-f5ed-4884-ac42-54ea7cfe0535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:10:23.950068 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:10:23.985830 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 481/939] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:10:23 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:10:24.334338 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1533b2d4-9856-4ea3-9f72-89f652dbae06 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:24.347295 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1533b2d4-9856-4ea3-9f72-89f652dbae06 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:24.351595 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760201a7-f34f-4d5d-9a5d-29d683f5ad51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:24.352373 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760201a7-f34f-4d5d-9a5d-29d683f5ad51 service neutron] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:24.352789 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760201a7-f34f-4d5d-9a5d-29d683f5ad51 service neutron] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:24.353193 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760201a7-f34f-4d5d-9a5d-29d683f5ad51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:24.364003 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760201a7-f34f-4d5d-9a5d-29d683f5ad51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:24.365628 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760201a7-f34f-4d5d-9a5d-29d683f5ad51 service neutron] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:24.378974 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 459/940] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:10:24 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:10:27.581380 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ca890-44a7-469c-81e5-470d8a8b8313 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:27.581939 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ca890-44a7-469c-81e5-470d8a8b8313 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:27.581939 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ca890-44a7-469c-81e5-470d8a8b8313 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:27.583165 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 482/941] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:10:27.589021 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd954292-afeb-4f5c-854a-8f97fbe098b1 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:27.589591 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd954292-afeb-4f5c-854a-8f97fbe098b1 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:27.589756 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd954292-afeb-4f5c-854a-8f97fbe098b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:27.612719 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-cd954292-afeb-4f5c-854a-8f97fbe098b1 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:10:27.614000 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-cd954292-afeb-4f5c-854a-8f97fbe098b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:10:27.689769 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 460/942] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:10:27 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:10:28.035377 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ca890-44a7-469c-81e5-470d8a8b8313 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:28.046865 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ca890-44a7-469c-81e5-470d8a8b8313 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:28.051387 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4a9e9-c9c5-45c4-9a30-42aa0f572085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:28.052106 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4a9e9-c9c5-45c4-9a30-42aa0f572085 service neutron] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:28.052431 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4a9e9-c9c5-45c4-9a30-42aa0f572085 service neutron] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:28.052744 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4a9e9-c9c5-45c4-9a30-42aa0f572085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:28.064855 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4a9e9-c9c5-45c4-9a30-42aa0f572085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:28.066342 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4a9e9-c9c5-45c4-9a30-42aa0f572085 service neutron] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:28.077556 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 483/943] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:10:28 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:10:32.102963 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff460ad-f30c-4984-a99e-bfe14080db19 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:32.103617 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff460ad-f30c-4984-a99e-bfe14080db19 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:32.103617 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff460ad-f30c-4984-a99e-bfe14080db19 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:32.104868 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 461/944] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:10:32.110659 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3a761-fbfd-4bab-bd64-65f45c723017 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:32.111210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3a761-fbfd-4bab-bd64-65f45c723017 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:32.111210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3a761-fbfd-4bab-bd64-65f45c723017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:32.137689 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-cbf3a761-fbfd-4bab-bd64-65f45c723017 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:10:32.140448 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-cbf3a761-fbfd-4bab-bd64-65f45c723017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:10:32.155035 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 484/945] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:10:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:10:32.500410 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff460ad-f30c-4984-a99e-bfe14080db19 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:32.520459 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff460ad-f30c-4984-a99e-bfe14080db19 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:32.525846 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dd6bd-796a-4bed-9015-d341f6d227b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:32.526637 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dd6bd-796a-4bed-9015-d341f6d227b0 service neutron] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:32.527074 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dd6bd-796a-4bed-9015-d341f6d227b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:32.527484 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dd6bd-796a-4bed-9015-d341f6d227b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:32.538813 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dd6bd-796a-4bed-9015-d341f6d227b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:32.540668 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dd6bd-796a-4bed-9015-d341f6d227b0 service neutron] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:32.552554 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 462/946] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:10:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:10:35.283689 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71255f9-d71b-4cbf-8f1e-42827e626518 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:35.284222 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71255f9-d71b-4cbf-8f1e-42827e626518 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:35.284567 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71255f9-d71b-4cbf-8f1e-42827e626518 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:35.287124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 485/947] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:10:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:10:35.295631 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406e2d5-8e67-4766-97f6-5362d3cdc21b None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:35.296453 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406e2d5-8e67-4766-97f6-5362d3cdc21b None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:35.296703 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406e2d5-8e67-4766-97f6-5362d3cdc21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:35.323461 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-8406e2d5-8e67-4766-97f6-5362d3cdc21b None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:10:35.324888 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-8406e2d5-8e67-4766-97f6-5362d3cdc21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:10:35.333923 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 463/948] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:10:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:10:35.938964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71255f9-d71b-4cbf-8f1e-42827e626518 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:35.957483 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71255f9-d71b-4cbf-8f1e-42827e626518 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:35.963219 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b3e45-cb97-4397-ab1c-7287216c0ee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:35.964215 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b3e45-cb97-4397-ab1c-7287216c0ee9 service neutron] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:35.964690 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b3e45-cb97-4397-ab1c-7287216c0ee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:35.965152 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b3e45-cb97-4397-ab1c-7287216c0ee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:35.981589 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b3e45-cb97-4397-ab1c-7287216c0ee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:35.984310 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b3e45-cb97-4397-ab1c-7287216c0ee9 service neutron] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:36.002259 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 486/949] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:10:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:10:39.132884 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93cc36-146f-463d-9eff-20241ade7717 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:39.133472 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93cc36-146f-463d-9eff-20241ade7717 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:39.133797 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93cc36-146f-463d-9eff-20241ade7717 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:39.135345 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 464/950] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:10:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:10:39.142044 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e03ec7-5eed-44cb-a4ae-5f9772cc4db9 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:39.142856 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e03ec7-5eed-44cb-a4ae-5f9772cc4db9 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:39.143046 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e03ec7-5eed-44cb-a4ae-5f9772cc4db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:39.164072 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-38e03ec7-5eed-44cb-a4ae-5f9772cc4db9 None None] MFA Rules not processed for user `ffaf170d5bc6440caacc8723c5238029`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:10:39.165372 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-38e03ec7-5eed-44cb-a4ae-5f9772cc4db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:10:39.174135 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 487/951] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:10:39 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:10:39.533821 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93cc36-146f-463d-9eff-20241ade7717 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:39.545852 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93cc36-146f-463d-9eff-20241ade7717 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:39.549566 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19acc70b-2589-4bd9-9f1d-de2b651472f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:39.550186 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acc70b-2589-4bd9-9f1d-de2b651472f9 service neutron] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:39.550467 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acc70b-2589-4bd9-9f1d-de2b651472f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:39.550735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acc70b-2589-4bd9-9f1d-de2b651472f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:39.561040 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19acc70b-2589-4bd9-9f1d-de2b651472f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:39.562527 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19acc70b-2589-4bd9-9f1d-de2b651472f9 service neutron] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:39.573648 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 465/952] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:10:39 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:10:42.339013 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295e921-c530-47aa-aa7f-e89928903261 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:42.339572 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295e921-c530-47aa-aa7f-e89928903261 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:42.339572 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295e921-c530-47aa-aa7f-e89928903261 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:42.340904 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 488/953] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:10:42.346874 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9009f-110d-4480-bfa4-8003aeca2dc6 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:42.347627 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9009f-110d-4480-bfa4-8003aeca2dc6 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:42.347787 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9009f-110d-4480-bfa4-8003aeca2dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:42.355609 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=65 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:10:42.369493 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-13a9009f-110d-4480-bfa4-8003aeca2dc6 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:10:42.370733 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-13a9009f-110d-4480-bfa4-8003aeca2dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:10:42.378836 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 466/954] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:10:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:10:42.719707 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295e921-c530-47aa-aa7f-e89928903261 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:42.730660 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295e921-c530-47aa-aa7f-e89928903261 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:42.734280 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0dd1a-371c-4600-a5a8-c88c5bbd8fcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:42.734895 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0dd1a-371c-4600-a5a8-c88c5bbd8fcf service neutron] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:42.735196 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0dd1a-371c-4600-a5a8-c88c5bbd8fcf service neutron] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:42.735464 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0dd1a-371c-4600-a5a8-c88c5bbd8fcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:42.745076 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0dd1a-371c-4600-a5a8-c88c5bbd8fcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:42.746545 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0dd1a-371c-4600-a5a8-c88c5bbd8fcf service neutron] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:42.756816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 489/955] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:10:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:10:45.330015 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66cefe-9f61-495f-8975-a0c618d6c2e5 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:45.330832 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66cefe-9f61-495f-8975-a0c618d6c2e5 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:45.330832 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66cefe-9f61-495f-8975-a0c618d6c2e5 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:45.331890 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 467/956] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:10:45.337599 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dcfa8-583e-43af-9874-58728e4a56cb None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:45.338388 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dcfa8-583e-43af-9874-58728e4a56cb None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:45.338388 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dcfa8-583e-43af-9874-58728e4a56cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:45.370595 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-097dcfa8-583e-43af-9874-58728e4a56cb None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:10:45.373541 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-097dcfa8-583e-43af-9874-58728e4a56cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:10:45.388591 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 490/957] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:10:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:10:45.729717 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66cefe-9f61-495f-8975-a0c618d6c2e5 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:45.741182 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66cefe-9f61-495f-8975-a0c618d6c2e5 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:45.744670 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7a638-0085-4e8b-ac4c-3e21626435d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:45.745267 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7a638-0085-4e8b-ac4c-3e21626435d3 service neutron] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:45.745583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7a638-0085-4e8b-ac4c-3e21626435d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:45.745870 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7a638-0085-4e8b-ac4c-3e21626435d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:45.755854 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7a638-0085-4e8b-ac4c-3e21626435d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:45.757321 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7a638-0085-4e8b-ac4c-3e21626435d3 service neutron] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:45.768547 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 468/958] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:10:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:10:48.706516 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf95b0e-1987-4295-ac19-12a40e715775 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:48.707150 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf95b0e-1987-4295-ac19-12a40e715775 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:48.707898 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf95b0e-1987-4295-ac19-12a40e715775 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:48.710492 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 491/959] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:10:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:10:48.719352 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb5db4-91ef-4ad8-89fb-8abef017ad55 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:48.719885 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb5db4-91ef-4ad8-89fb-8abef017ad55 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:48.720009 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb5db4-91ef-4ad8-89fb-8abef017ad55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:48.739589 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-37cb5db4-91ef-4ad8-89fb-8abef017ad55 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:10:48.740791 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-37cb5db4-91ef-4ad8-89fb-8abef017ad55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:10:48.748903 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 469/960] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:10:48 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:10:49.091630 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf95b0e-1987-4295-ac19-12a40e715775 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:49.102827 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf95b0e-1987-4295-ac19-12a40e715775 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:49.107034 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdaa961-5008-459d-b705-83cdeef143d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:49.107777 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdaa961-5008-459d-b705-83cdeef143d1 service neutron] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:49.108160 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdaa961-5008-459d-b705-83cdeef143d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:49.108514 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdaa961-5008-459d-b705-83cdeef143d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:49.118511 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdaa961-5008-459d-b705-83cdeef143d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:49.120025 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdaa961-5008-459d-b705-83cdeef143d1 service neutron] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:49.131371 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 492/961] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:10:49 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:10:53.969947 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971ed0d-4ae1-4ca0-99bd-f5abace9e4a7 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:53.970736 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971ed0d-4ae1-4ca0-99bd-f5abace9e4a7 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:53.970736 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971ed0d-4ae1-4ca0-99bd-f5abace9e4a7 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:53.972300 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 470/962] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:10:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:10:53.978944 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c63ef9-0615-4b0a-ba26-d26d393ce65b None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:53.979420 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c63ef9-0615-4b0a-ba26-d26d393ce65b None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:53.979783 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c63ef9-0615-4b0a-ba26-d26d393ce65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:53.988464 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=45 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:10:54.003293 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-63c63ef9-0615-4b0a-ba26-d26d393ce65b None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:10:54.004511 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-63c63ef9-0615-4b0a-ba26-d26d393ce65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:10:54.013100 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 493/963] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:10:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:10:54.371320 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971ed0d-4ae1-4ca0-99bd-f5abace9e4a7 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:54.382661 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971ed0d-4ae1-4ca0-99bd-f5abace9e4a7 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:54.386245 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0576cb-364f-4b81-b555-b94016f309d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:54.386854 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0576cb-364f-4b81-b555-b94016f309d3 service neutron] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:54.387131 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0576cb-364f-4b81-b555-b94016f309d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:54.387400 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0576cb-364f-4b81-b555-b94016f309d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:54.397224 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0576cb-364f-4b81-b555-b94016f309d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:54.398705 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0576cb-364f-4b81-b555-b94016f309d3 service neutron] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:54.410949 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 471/964] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:10:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:10:58.331708 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d1f0e-6d7b-49ee-9fc3-a9ab0c8736e2 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:58.332547 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d1f0e-6d7b-49ee-9fc3-a9ab0c8736e2 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:58.332547 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d1f0e-6d7b-49ee-9fc3-a9ab0c8736e2 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:58.333679 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 494/965] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:10:58.342690 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9128ad-9720-4d52-9825-3355900fa1a5 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:58.343493 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9128ad-9720-4d52-9825-3355900fa1a5 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:58.343493 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9128ad-9720-4d52-9825-3355900fa1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:58.374649 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-9f9128ad-9720-4d52-9825-3355900fa1a5 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:10:58.376651 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-9f9128ad-9720-4d52-9825-3355900fa1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:10:58.389349 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 472/966] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:10:58 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:10:58.823413 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d1f0e-6d7b-49ee-9fc3-a9ab0c8736e2 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:58.834340 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d1f0e-6d7b-49ee-9fc3-a9ab0c8736e2 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:58.837814 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4862f-ef82-48cf-a143-aa8b911a4efe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:58.838416 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4862f-ef82-48cf-a143-aa8b911a4efe service neutron] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:58.838694 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4862f-ef82-48cf-a143-aa8b911a4efe service neutron] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:58.838964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4862f-ef82-48cf-a143-aa8b911a4efe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:58.849503 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a4862f-ef82-48cf-a143-aa8b911a4efe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:58.851416 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a4862f-ef82-48cf-a143-aa8b911a4efe service neutron] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:58.863017 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 495/967] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:10:58 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:11:03.623229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bdd4d-2c8d-4509-be79-103b5ce1f932 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:03.624054 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bdd4d-2c8d-4509-be79-103b5ce1f932 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:03.624054 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bdd4d-2c8d-4509-be79-103b5ce1f932 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:03.625173 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 473/968] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:11:03.631608 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c04a3e-201f-4824-b3a9-968c76d4fd72 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:03.632252 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c04a3e-201f-4824-b3a9-968c76d4fd72 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:03.632252 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c04a3e-201f-4824-b3a9-968c76d4fd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:03.653439 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-d3c04a3e-201f-4824-b3a9-968c76d4fd72 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:11:03.655213 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-d3c04a3e-201f-4824-b3a9-968c76d4fd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:11:03.663669 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 496/969] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:11:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:11:04.006479 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52bdd4d-2c8d-4509-be79-103b5ce1f932 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:04.022227 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52bdd4d-2c8d-4509-be79-103b5ce1f932 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:04.027237 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391996ca-9a98-44f9-af88-57d4fa4acb5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:04.028052 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391996ca-9a98-44f9-af88-57d4fa4acb5b service neutron] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:04.028489 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391996ca-9a98-44f9-af88-57d4fa4acb5b service neutron] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:04.028911 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391996ca-9a98-44f9-af88-57d4fa4acb5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:04.043051 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391996ca-9a98-44f9-af88-57d4fa4acb5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:04.045148 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391996ca-9a98-44f9-af88-57d4fa4acb5b service neutron] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:04.056480 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 474/970] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:11:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:11:10.504174 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e0961-1c35-4128-a9c0-904c0b66c2a2 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:10.507115 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e0961-1c35-4128-a9c0-904c0b66c2a2 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:10.507115 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e0961-1c35-4128-a9c0-904c0b66c2a2 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:10.507115 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 497/971] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 9 11:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:11:10.518775 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792207e-632c-42b3-8397-ca5935dc51bb None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:10.524083 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792207e-632c-42b3-8397-ca5935dc51bb None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:10.524710 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792207e-632c-42b3-8397-ca5935dc51bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:10.614062 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-7792207e-632c-42b3-8397-ca5935dc51bb None None] MFA Rules not processed for user `ff72ca8bbc74499bb18ad4cb3ae2024c`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:11:10.615649 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-7792207e-632c-42b3-8397-ca5935dc51bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:11:10.741092 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 475/972] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 9 11:11:10 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:11:13.648142 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=11 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:15.864890 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240a207-6bea-4049-8ea7-0f56d2abedac None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:15.866921 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240a207-6bea-4049-8ea7-0f56d2abedac None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:15.867739 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240a207-6bea-4049-8ea7-0f56d2abedac None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:15.871281 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 498/973] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 9 11:11:15 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:11:15.877464 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40177bf4-fff3-445e-9cc9-ac85f6ddbd3f None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:15.877981 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40177bf4-fff3-445e-9cc9-ac85f6ddbd3f None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:15.878529 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40177bf4-fff3-445e-9cc9-ac85f6ddbd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:15.892601 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=66 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:15.916643 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-40177bf4-fff3-445e-9cc9-ac85f6ddbd3f None None] MFA Rules not processed for user `ff72ca8bbc74499bb18ad4cb3ae2024c`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:11:15.919222 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-40177bf4-fff3-445e-9cc9-ac85f6ddbd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:11:15.936652 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 476/974] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 9 11:11:15 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:11:18.002084 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d199671-82c5-4ad2-b49b-6ac6fbadfd53 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:18.002671 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d199671-82c5-4ad2-b49b-6ac6fbadfd53 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:18.002671 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d199671-82c5-4ad2-b49b-6ac6fbadfd53 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:18.003925 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 499/975] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 9 11:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:11:18.009246 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b64131-ab0f-447d-836e-61d79183ad20 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:18.009785 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b64131-ab0f-447d-836e-61d79183ad20 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:18.009894 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b64131-ab0f-447d-836e-61d79183ad20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:18.030186 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-47b64131-ab0f-447d-836e-61d79183ad20 None None] MFA Rules not processed for user `ff72ca8bbc74499bb18ad4cb3ae2024c`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:11:18.031390 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-47b64131-ab0f-447d-836e-61d79183ad20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:11:18.040108 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 477/976] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 9 11:11:18 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:11:23.126214 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493e27a-5ae1-4ce6-a0f3-305122493b43 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:23.127016 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493e27a-5ae1-4ce6-a0f3-305122493b43 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:23.127016 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493e27a-5ae1-4ce6-a0f3-305122493b43 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:23.129334 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 500/977] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:11:23.136354 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1968150-3a8a-49a8-a2a7-d818ac63642a None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:23.137142 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1968150-3a8a-49a8-a2a7-d818ac63642a None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:23.137142 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1968150-3a8a-49a8-a2a7-d818ac63642a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:23.168223 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-f1968150-3a8a-49a8-a2a7-d818ac63642a None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:11:23.170438 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-f1968150-3a8a-49a8-a2a7-d818ac63642a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:11:23.184044 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 478/978] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:11:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:11:23.611597 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170498a-9124-4aba-8867-31bae5369402 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:23.612036 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170498a-9124-4aba-8867-31bae5369402 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:23.612366 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170498a-9124-4aba-8867-31bae5369402 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:23.614036 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 501/979] 10.222.0.20 () {54 vars in 962 bytes} [Fri Sep 9 11:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:11:23.624125 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33aadef-cfc8-46af-846b-ffe4365fab7b None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:23.625026 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33aadef-cfc8-46af-846b-ffe4365fab7b None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:23.625691 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33aadef-cfc8-46af-846b-ffe4365fab7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:23.693125 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-d33aadef-cfc8-46af-846b-ffe4365fab7b None None] MFA Rules not processed for user `417acfbae1244469961371115a42498e`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:11:23.694464 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-d33aadef-cfc8-46af-846b-ffe4365fab7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:11:23.780188 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 479/980] 10.222.0.20 () {58 vars in 1059 bytes} [Fri Sep 9 11:11:23 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:11:23.793889 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170498a-9124-4aba-8867-31bae5369402 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:23.811930 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170498a-9124-4aba-8867-31bae5369402 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:23.820251 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd6ee1-33b3-463c-baa4-5db212d4d0e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:23.821330 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd6ee1-33b3-463c-baa4-5db212d4d0e1 service nova] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:23.821841 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd6ee1-33b3-463c-baa4-5db212d4d0e1 service nova] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:23.822329 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd6ee1-33b3-463c-baa4-5db212d4d0e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:23.838791 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd6ee1-33b3-463c-baa4-5db212d4d0e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:23.842398 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd6ee1-33b3-463c-baa4-5db212d4d0e1 service nova] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:23.854284 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 502/981] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:11:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:11:27.197846 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003d766-3e56-41b9-bbac-ca1c04e58351 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:27.198661 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003d766-3e56-41b9-bbac-ca1c04e58351 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:27.198825 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003d766-3e56-41b9-bbac-ca1c04e58351 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:27.202016 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 480/982] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:11:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:11:27.211292 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43833e-5062-4a5d-9b95-392eab252d48 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:27.212097 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43833e-5062-4a5d-9b95-392eab252d48 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:27.212258 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43833e-5062-4a5d-9b95-392eab252d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:27.245779 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-9c43833e-5062-4a5d-9b95-392eab252d48 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:11:27.248040 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-9c43833e-5062-4a5d-9b95-392eab252d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:11:27.262417 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 503/983] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:11:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:11:27.870215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003d766-3e56-41b9-bbac-ca1c04e58351 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:27.894646 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003d766-3e56-41b9-bbac-ca1c04e58351 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:27.902415 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d76c17-63c5-47c7-80fb-f9673d8227a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:27.903345 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d76c17-63c5-47c7-80fb-f9673d8227a2 service nova] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:27.903764 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d76c17-63c5-47c7-80fb-f9673d8227a2 service nova] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:27.904172 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d76c17-63c5-47c7-80fb-f9673d8227a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:27.920865 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d76c17-63c5-47c7-80fb-f9673d8227a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:27.926031 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d76c17-63c5-47c7-80fb-f9673d8227a2 service nova] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:27.953842 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 481/984] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:11:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:11:31.168634 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a7b27-4961-4243-ab3f-a02bd1ce71a0 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:31.169150 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a7b27-4961-4243-ab3f-a02bd1ce71a0 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:31.169600 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a7b27-4961-4243-ab3f-a02bd1ce71a0 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:31.172319 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 504/985] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:11:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:11:31.178606 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc41b1c-3aab-4487-8aa2-68110d28ec30 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:31.179154 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc41b1c-3aab-4487-8aa2-68110d28ec30 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:31.179279 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc41b1c-3aab-4487-8aa2-68110d28ec30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:31.203299 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-0bc41b1c-3aab-4487-8aa2-68110d28ec30 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:11:31.208126 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-0bc41b1c-3aab-4487-8aa2-68110d28ec30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:11:31.233863 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 482/986] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:11:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:11:31.811787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba9a80-07b5-47d5-8019-99fbb516970e None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:31.812436 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba9a80-07b5-47d5-8019-99fbb516970e None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:31.812857 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba9a80-07b5-47d5-8019-99fbb516970e None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:31.814544 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 505/987] 10.222.0.20 () {54 vars in 962 bytes} [Fri Sep 9 11:11:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:11:31.825459 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee24dc-229e-4d69-9df4-41ae622afa5c None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:31.825882 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee24dc-229e-4d69-9df4-41ae622afa5c None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:31.826326 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee24dc-229e-4d69-9df4-41ae622afa5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:31.860281 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-2cee24dc-229e-4d69-9df4-41ae622afa5c None None] MFA Rules not processed for user `417acfbae1244469961371115a42498e`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:11:31.862254 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-2cee24dc-229e-4d69-9df4-41ae622afa5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:11:31.877226 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 483/988] 10.222.0.20 () {58 vars in 1059 bytes} [Fri Sep 9 11:11:31 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:11:31.890004 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba9a80-07b5-47d5-8019-99fbb516970e None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:31.910758 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba9a80-07b5-47d5-8019-99fbb516970e None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:31.921790 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5077e3-ee46-47f4-8a1f-7c4890aad222 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:31.922747 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5077e3-ee46-47f4-8a1f-7c4890aad222 service nova] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:31.923206 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5077e3-ee46-47f4-8a1f-7c4890aad222 service nova] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:31.923651 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5077e3-ee46-47f4-8a1f-7c4890aad222 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:31.938502 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5077e3-ee46-47f4-8a1f-7c4890aad222 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:31.940972 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5077e3-ee46-47f4-8a1f-7c4890aad222 service nova] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:31.957374 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 506/989] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:11:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:11:34.904838 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de92244-b603-42a4-b6e8-a2310b4c5dba None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:34.906018 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de92244-b603-42a4-b6e8-a2310b4c5dba None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:34.906538 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de92244-b603-42a4-b6e8-a2310b4c5dba None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:34.908197 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 484/990] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:11:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:11:34.917155 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf89fcd-65e1-456b-85fe-ee0192de0654 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:34.918715 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf89fcd-65e1-456b-85fe-ee0192de0654 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:34.919286 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf89fcd-65e1-456b-85fe-ee0192de0654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:34.944634 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-dcf89fcd-65e1-456b-85fe-ee0192de0654 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:11:34.946323 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-dcf89fcd-65e1-456b-85fe-ee0192de0654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:11:34.962579 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 507/991] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:11:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:11:35.373205 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de92244-b603-42a4-b6e8-a2310b4c5dba None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:35.389890 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de92244-b603-42a4-b6e8-a2310b4c5dba None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:35.395983 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c8feb-0585-40f1-818d-40443a8d2cab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:35.397042 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c8feb-0585-40f1-818d-40443a8d2cab service nova] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:35.397603 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c8feb-0585-40f1-818d-40443a8d2cab service nova] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:35.398088 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c8feb-0585-40f1-818d-40443a8d2cab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:35.408997 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c8feb-0585-40f1-818d-40443a8d2cab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:35.411270 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c8feb-0585-40f1-818d-40443a8d2cab service nova] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:35.431196 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 485/992] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:11:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:11:37.035830 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d085c4d-cb86-4095-bec0-a24ebe055513 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:37.036475 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d085c4d-cb86-4095-bec0-a24ebe055513 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:37.036475 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d085c4d-cb86-4095-bec0-a24ebe055513 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:37.037770 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 508/993] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:11:37.045537 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03fb8a-fa1c-41ec-8bea-07cfd0197433 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:37.046181 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03fb8a-fa1c-41ec-8bea-07cfd0197433 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:37.046492 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03fb8a-fa1c-41ec-8bea-07cfd0197433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:37.072450 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-fc03fb8a-fa1c-41ec-8bea-07cfd0197433 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:11:37.073747 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-fc03fb8a-fa1c-41ec-8bea-07cfd0197433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:11:37.093762 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 486/994] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:11:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:11:37.499596 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255fd93-4fba-44f6-ab67-aae41aa34d9e None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:37.499878 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255fd93-4fba-44f6-ab67-aae41aa34d9e None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:37.500352 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255fd93-4fba-44f6-ab67-aae41aa34d9e None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:37.501720 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 509/995] 10.222.0.20 () {54 vars in 964 bytes} [Fri Sep 9 11:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:11:37.508176 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94e14f-4012-4294-af29-200db15c4282 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:37.508776 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94e14f-4012-4294-af29-200db15c4282 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:37.509404 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94e14f-4012-4294-af29-200db15c4282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:37.577662 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-ae94e14f-4012-4294-af29-200db15c4282 None None] MFA Rules not processed for user `c779e851ccf2438594c450eb479c7717`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:11:37.578885 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-ae94e14f-4012-4294-af29-200db15c4282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:11:37.651293 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:37.666793 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 487/996] 10.222.0.20 () {58 vars in 1061 bytes} [Fri Sep 9 11:11:37 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:11:37.668770 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255fd93-4fba-44f6-ab67-aae41aa34d9e None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:37.683992 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255fd93-4fba-44f6-ab67-aae41aa34d9e None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:37.688308 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e69072-4d9d-4310-a3d1-adc06912f7aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c779e851ccf2438594c450eb479c7717', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:37.689328 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e69072-4d9d-4310-a3d1-adc06912f7aa service cinder] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:37.689837 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e69072-4d9d-4310-a3d1-adc06912f7aa service cinder] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:37.690391 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e69072-4d9d-4310-a3d1-adc06912f7aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:37.702321 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e69072-4d9d-4310-a3d1-adc06912f7aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:37.703979 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e69072-4d9d-4310-a3d1-adc06912f7aa service cinder] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:37.716152 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 510/997] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:11:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:11:38.636624 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43db71-37c6-4183-ae09-a6fafef1daa7 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:38.637530 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43db71-37c6-4183-ae09-a6fafef1daa7 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:38.637804 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43db71-37c6-4183-ae09-a6fafef1daa7 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:38.640224 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 488/998] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:11:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:11:38.647325 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886c488-bd3d-4233-a63e-0cb13b315c36 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:38.647325 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886c488-bd3d-4233-a63e-0cb13b315c36 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:38.647325 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886c488-bd3d-4233-a63e-0cb13b315c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:38.673439 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-7886c488-bd3d-4233-a63e-0cb13b315c36 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:11:38.677894 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-7886c488-bd3d-4233-a63e-0cb13b315c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:11:38.689309 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 511/999] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:11:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:11:39.047760 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43db71-37c6-4183-ae09-a6fafef1daa7 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:39.063553 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43db71-37c6-4183-ae09-a6fafef1daa7 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:39.069098 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb21d5-b5f8-494b-9ff9-a7948fc938ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:39.069876 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb21d5-b5f8-494b-9ff9-a7948fc938ad service nova] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:39.070326 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb21d5-b5f8-494b-9ff9-a7948fc938ad service nova] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:39.070709 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb21d5-b5f8-494b-9ff9-a7948fc938ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:39.081212 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb21d5-b5f8-494b-9ff9-a7948fc938ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:39.082843 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb21d5-b5f8-494b-9ff9-a7948fc938ad service nova] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:39.093630 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 489/1000] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:11:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:11:42.195753 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e459ce-2571-4a2f-9c3a-995ce34d7d60 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:42.196572 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e459ce-2571-4a2f-9c3a-995ce34d7d60 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:42.196572 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e459ce-2571-4a2f-9c3a-995ce34d7d60 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:42.197876 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 512/1001] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:11:42.207164 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1f8c0-5dc7-495f-884a-ee33fc989a52 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:42.207943 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1f8c0-5dc7-495f-884a-ee33fc989a52 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:42.208102 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1f8c0-5dc7-495f-884a-ee33fc989a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:42.229522 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-cba1f8c0-5dc7-495f-884a-ee33fc989a52 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:11:42.230898 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-cba1f8c0-5dc7-495f-884a-ee33fc989a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:11:42.240984 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 490/1002] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:11:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:11:42.663380 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e459ce-2571-4a2f-9c3a-995ce34d7d60 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:42.698102 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e459ce-2571-4a2f-9c3a-995ce34d7d60 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:42.707542 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16fdb9-c61e-4f60-af9d-ed7316386755 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:42.708336 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16fdb9-c61e-4f60-af9d-ed7316386755 service nova] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:42.708619 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16fdb9-c61e-4f60-af9d-ed7316386755 service nova] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:42.708893 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16fdb9-c61e-4f60-af9d-ed7316386755 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:42.724811 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16fdb9-c61e-4f60-af9d-ed7316386755 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:42.727938 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16fdb9-c61e-4f60-af9d-ed7316386755 service nova] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:42.748274 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 513/1003] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:11:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:11:45.828803 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622de64-ea0e-43a4-9837-9b8909d165d7 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:45.829693 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622de64-ea0e-43a4-9837-9b8909d165d7 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:45.829693 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622de64-ea0e-43a4-9837-9b8909d165d7 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:45.835321 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 491/1004] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:11:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:11:45.836938 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79626bb1-606d-4ba9-bfa7-dabfd1f67cd3 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:45.837444 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79626bb1-606d-4ba9-bfa7-dabfd1f67cd3 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:45.837541 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79626bb1-606d-4ba9-bfa7-dabfd1f67cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:45.858531 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-79626bb1-606d-4ba9-bfa7-dabfd1f67cd3 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:11:45.859750 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-79626bb1-606d-4ba9-bfa7-dabfd1f67cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:11:45.868484 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 514/1005] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:11:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:11:46.223589 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622de64-ea0e-43a4-9837-9b8909d165d7 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:46.238153 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622de64-ea0e-43a4-9837-9b8909d165d7 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:46.243786 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad91a7-fc07-4df4-8da9-1522b3a776ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:46.244490 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad91a7-fc07-4df4-8da9-1522b3a776ae service nova] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:46.244859 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad91a7-fc07-4df4-8da9-1522b3a776ae service nova] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:46.245203 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad91a7-fc07-4df4-8da9-1522b3a776ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:46.255774 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad91a7-fc07-4df4-8da9-1522b3a776ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:46.257468 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad91a7-fc07-4df4-8da9-1522b3a776ae service nova] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:46.269488 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 492/1006] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:11:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:11:49.281393 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695eb571-3e60-4fbd-8d1b-24b1f8bbdf71 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:49.291648 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695eb571-3e60-4fbd-8d1b-24b1f8bbdf71 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:49.291648 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695eb571-3e60-4fbd-8d1b-24b1f8bbdf71 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:49.291648 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 515/1007] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:11:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:11:49.293533 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e67e3-146b-4335-ae24-f86a29923214 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:49.294064 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e67e3-146b-4335-ae24-f86a29923214 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:49.294435 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e67e3-146b-4335-ae24-f86a29923214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:49.350497 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-915e67e3-146b-4335-ae24-f86a29923214 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:11:49.352106 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-915e67e3-146b-4335-ae24-f86a29923214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:11:49.363484 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 493/1008] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:11:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:11:49.763385 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695eb571-3e60-4fbd-8d1b-24b1f8bbdf71 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:49.782289 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695eb571-3e60-4fbd-8d1b-24b1f8bbdf71 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:49.790220 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533ffd5-d149-4487-a1e2-8999dbf4ad07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:49.791064 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533ffd5-d149-4487-a1e2-8999dbf4ad07 service nova] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:49.791409 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533ffd5-d149-4487-a1e2-8999dbf4ad07 service nova] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:49.791727 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533ffd5-d149-4487-a1e2-8999dbf4ad07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:49.802538 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e533ffd5-d149-4487-a1e2-8999dbf4ad07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:49.804410 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e533ffd5-d149-4487-a1e2-8999dbf4ad07 service nova] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:49.815198 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 516/1009] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:11:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:11:53.359927 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ddede-8602-4638-a086-89717cb2f4cd None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:53.361358 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ddede-8602-4638-a086-89717cb2f4cd None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:53.361358 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ddede-8602-4638-a086-89717cb2f4cd None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:53.362518 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 494/1010] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:11:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:11:53.369088 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebd068-44f0-492e-8e99-6d51e6d30432 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:53.370061 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebd068-44f0-492e-8e99-6d51e6d30432 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:53.370061 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebd068-44f0-492e-8e99-6d51e6d30432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:53.392959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-61ebd068-44f0-492e-8e99-6d51e6d30432 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:11:53.394369 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-61ebd068-44f0-492e-8e99-6d51e6d30432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:11:53.406085 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 517/1011] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:11:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:11:54.088499 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ddede-8602-4638-a086-89717cb2f4cd None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:54.104130 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ddede-8602-4638-a086-89717cb2f4cd None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:54.109775 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69247c08-d850-45b2-8a18-c123ea4763bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:54.110483 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69247c08-d850-45b2-8a18-c123ea4763bb service nova] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:54.110868 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69247c08-d850-45b2-8a18-c123ea4763bb service nova] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:54.111306 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69247c08-d850-45b2-8a18-c123ea4763bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:54.121136 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69247c08-d850-45b2-8a18-c123ea4763bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:54.122774 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69247c08-d850-45b2-8a18-c123ea4763bb service nova] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:54.133129 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 495/1012] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:11:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:11:55.729996 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23ba3a-8f2e-4975-9aff-da2b16c09939 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:55.730621 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23ba3a-8f2e-4975-9aff-da2b16c09939 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:55.730861 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23ba3a-8f2e-4975-9aff-da2b16c09939 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:55.733129 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 518/1013] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:11:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:11:55.742229 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1294fa-5206-43d7-ad96-d5283777e470 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:55.742798 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1294fa-5206-43d7-ad96-d5283777e470 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:55.743196 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1294fa-5206-43d7-ad96-d5283777e470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:55.775124 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-fb1294fa-5206-43d7-ad96-d5283777e470 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:11:55.776884 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-fb1294fa-5206-43d7-ad96-d5283777e470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:11:55.793319 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 496/1014] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:11:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:11:56.158478 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d4a74-6e87-45a6-9b99-2449db268646 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:56.158741 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d4a74-6e87-45a6-9b99-2449db268646 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:56.159027 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d4a74-6e87-45a6-9b99-2449db268646 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:56.160351 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 519/1015] 10.222.0.20 () {54 vars in 966 bytes} [Fri Sep 9 11:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:11:56.165909 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cee5b6-89e8-4aa3-86e5-d627b202b6c7 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:56.166435 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cee5b6-89e8-4aa3-86e5-d627b202b6c7 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:56.167066 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cee5b6-89e8-4aa3-86e5-d627b202b6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:56.219683 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-19cee5b6-89e8-4aa3-86e5-d627b202b6c7 None None] MFA Rules not processed for user `9d2e6375358545ac80db469ea4c2deb1`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:11:56.220905 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-19cee5b6-89e8-4aa3-86e5-d627b202b6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:11:56.325532 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 497/1016] 10.222.0.20 () {58 vars in 1063 bytes} [Fri Sep 9 11:11:56 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:11:56.340072 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d4a74-6e87-45a6-9b99-2449db268646 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:56.346636 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=46 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:56.353438 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d4a74-6e87-45a6-9b99-2449db268646 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:56.357034 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb365c-3278-459d-9917-0b057035ecf0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d2e6375358545ac80db469ea4c2deb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:56.357677 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb365c-3278-459d-9917-0b057035ecf0 service glance] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:56.357953 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb365c-3278-459d-9917-0b057035ecf0 service glance] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:56.358232 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb365c-3278-459d-9917-0b057035ecf0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:56.369139 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb365c-3278-459d-9917-0b057035ecf0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:56.370637 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb365c-3278-459d-9917-0b057035ecf0 service glance] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:56.389504 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 520/1017] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:11:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:11:56.705921 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba60a5-0118-4982-b7fe-685d7f75f1cf None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:56.706179 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba60a5-0118-4982-b7fe-685d7f75f1cf None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:56.706454 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba60a5-0118-4982-b7fe-685d7f75f1cf None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:56.707798 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 498/1018] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:11:56.713429 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503d3d0-a967-4198-8c8e-f8c74b036d19 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:56.713723 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503d3d0-a967-4198-8c8e-f8c74b036d19 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:56.714005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503d3d0-a967-4198-8c8e-f8c74b036d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:56.735738 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-1503d3d0-a967-4198-8c8e-f8c74b036d19 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:11:56.737009 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-1503d3d0-a967-4198-8c8e-f8c74b036d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:11:56.745174 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 521/1019] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:11:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:11:57.141837 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba60a5-0118-4982-b7fe-685d7f75f1cf None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:57.161586 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba60a5-0118-4982-b7fe-685d7f75f1cf None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:57.165530 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e0f52-5d74-4ee9-8f70-883ced505257 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:57.166164 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e0f52-5d74-4ee9-8f70-883ced505257 service nova] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:57.166448 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e0f52-5d74-4ee9-8f70-883ced505257 service nova] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:57.166723 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e0f52-5d74-4ee9-8f70-883ced505257 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:57.178218 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e0f52-5d74-4ee9-8f70-883ced505257 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:57.178945 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e0f52-5d74-4ee9-8f70-883ced505257 service nova] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:57.194500 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 499/1020] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:11:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:11:59.895038 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04832b44-6e51-4223-bd78-9f7e8492f338 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:59.896173 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04832b44-6e51-4223-bd78-9f7e8492f338 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:59.896458 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04832b44-6e51-4223-bd78-9f7e8492f338 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:59.898009 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 522/1021] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:11:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:11:59.903880 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dd152-953c-4c6b-997c-02a1d4aca6ac None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:59.904821 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dd152-953c-4c6b-997c-02a1d4aca6ac None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:59.904821 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dd152-953c-4c6b-997c-02a1d4aca6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:59.927158 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-3b1dd152-953c-4c6b-997c-02a1d4aca6ac None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:11:59.930295 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-3b1dd152-953c-4c6b-997c-02a1d4aca6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:11:59.939855 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 500/1022] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:11:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:12:00.338051 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04832b44-6e51-4223-bd78-9f7e8492f338 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:12:00.360628 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04832b44-6e51-4223-bd78-9f7e8492f338 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:12:00.367611 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df674b2-fa40-4cb9-b6d0-380dd1eb8f0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:12:00.367611 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df674b2-fa40-4cb9-b6d0-380dd1eb8f0c service nova] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:00.367611 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df674b2-fa40-4cb9-b6d0-380dd1eb8f0c service nova] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:00.367611 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df674b2-fa40-4cb9-b6d0-380dd1eb8f0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:00.376677 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df674b2-fa40-4cb9-b6d0-380dd1eb8f0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:12:00.378297 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df674b2-fa40-4cb9-b6d0-380dd1eb8f0c service nova] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:12:00.397578 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 523/1023] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:12:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:12:03.218613 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7d956-88fd-4137-918c-9d052b0e1482 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:03.219453 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7d956-88fd-4137-918c-9d052b0e1482 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:03.219453 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7d956-88fd-4137-918c-9d052b0e1482 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:03.220532 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 501/1024] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:12:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:12:03.226518 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d945848-af2b-4624-a5cb-636375249554 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:03.227286 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d945848-af2b-4624-a5cb-636375249554 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:03.227286 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d945848-af2b-4624-a5cb-636375249554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:03.251359 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-9d945848-af2b-4624-a5cb-636375249554 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:12:03.252624 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-9d945848-af2b-4624-a5cb-636375249554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:12:03.266890 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 524/1025] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:12:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:12:03.659896 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7d956-88fd-4137-918c-9d052b0e1482 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:12:03.680320 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7d956-88fd-4137-918c-9d052b0e1482 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:12:03.689457 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008947f9-ffc1-49a3-89f2-9e5bd31a593b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:12:03.690501 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008947f9-ffc1-49a3-89f2-9e5bd31a593b service nova] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:03.690990 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008947f9-ffc1-49a3-89f2-9e5bd31a593b service nova] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:03.691465 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008947f9-ffc1-49a3-89f2-9e5bd31a593b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:03.707514 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008947f9-ffc1-49a3-89f2-9e5bd31a593b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:12:03.711155 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008947f9-ffc1-49a3-89f2-9e5bd31a593b service nova] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:12:03.729917 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 502/1026] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:12:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:12:13.007718 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b95fa-7bda-45e2-b3ad-26d7e8bdf353 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:13.008368 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b95fa-7bda-45e2-b3ad-26d7e8bdf353 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:13.008368 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b95fa-7bda-45e2-b3ad-26d7e8bdf353 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:13.009640 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 525/1027] 10.222.0.20 () {54 vars in 918 bytes} [Fri Sep 9 11:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:12:13.015718 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d71602-426f-4f44-81c3-2ab5164631a8 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:13.016401 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d71602-426f-4f44-81c3-2ab5164631a8 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:13.016401 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d71602-426f-4f44-81c3-2ab5164631a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:13.024245 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=77 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:12:13.039917 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-f9d71602-426f-4f44-81c3-2ab5164631a8 None None] MFA Rules not processed for user `ff72ca8bbc74499bb18ad4cb3ae2024c`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:12:13.041136 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-f9d71602-426f-4f44-81c3-2ab5164631a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:12:13.053989 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 503/1028] 10.222.0.20 () {58 vars in 1015 bytes} [Fri Sep 9 11:12:13 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:12:13.071490 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226520a-a486-498b-a0ce-54cd3dd73b3c None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:13.071824 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226520a-a486-498b-a0ce-54cd3dd73b3c None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:13.072144 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226520a-a486-498b-a0ce-54cd3dd73b3c None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:13.073586 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 526/1029] 10.222.0.20 () {54 vars in 918 bytes} [Fri Sep 9 11:12:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:12:13.079145 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fdbef-1457-4490-bc65-b4a23894884a None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:13.079424 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fdbef-1457-4490-bc65-b4a23894884a None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:13.079695 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fdbef-1457-4490-bc65-b4a23894884a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:13.099752 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-733fdbef-1457-4490-bc65-b4a23894884a None None] MFA Rules not processed for user `417acfbae1244469961371115a42498e`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:12:13.100960 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-733fdbef-1457-4490-bc65-b4a23894884a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:12:13.111075 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 504/1030] 10.222.0.20 () {58 vars in 1015 bytes} [Fri Sep 9 11:12:13 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:12:13.245200 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=17 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:12:16.210639 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436abc6-6dc3-41ab-8b19-9f0bc9378c16 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:16.211335 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436abc6-6dc3-41ab-8b19-9f0bc9378c16 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:16.211335 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436abc6-6dc3-41ab-8b19-9f0bc9378c16 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:16.212587 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 527/1031] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:12:16.218938 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4b8ea-4cf3-4e9c-a403-786005c1d1be None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:16.219403 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4b8ea-4cf3-4e9c-a403-786005c1d1be None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:16.219533 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4b8ea-4cf3-4e9c-a403-786005c1d1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:16.240979 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-d3d4b8ea-4cf3-4e9c-a403-786005c1d1be None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:12:16.242046 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-d3d4b8ea-4cf3-4e9c-a403-786005c1d1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:12:16.250096 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 505/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:12:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:12:16.604141 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436abc6-6dc3-41ab-8b19-9f0bc9378c16 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:12:16.619272 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436abc6-6dc3-41ab-8b19-9f0bc9378c16 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:12:16.624223 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a672d-74ea-4e59-a20a-03217e197050 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:12:16.624832 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a672d-74ea-4e59-a20a-03217e197050 service nova] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:16.625099 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a672d-74ea-4e59-a20a-03217e197050 service nova] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:16.625397 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a672d-74ea-4e59-a20a-03217e197050 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:16.634906 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a672d-74ea-4e59-a20a-03217e197050 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:12:16.636490 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a672d-74ea-4e59-a20a-03217e197050 service nova] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:12:16.647481 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 528/1033] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:12:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:12:18.423674 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd86e0-e1e0-48dc-a896-da4f1a099f13 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:18.424282 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd86e0-e1e0-48dc-a896-da4f1a099f13 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:18.424282 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd86e0-e1e0-48dc-a896-da4f1a099f13 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:18.425723 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 506/1034] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:12:18.431546 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a428fd-8536-4a37-98bc-603d9acf79f4 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:18.432128 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a428fd-8536-4a37-98bc-603d9acf79f4 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:18.432128 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a428fd-8536-4a37-98bc-603d9acf79f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:18.454648 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-a4a428fd-8536-4a37-98bc-603d9acf79f4 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:12:18.455877 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-a4a428fd-8536-4a37-98bc-603d9acf79f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:12:18.464196 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 529/1035] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:12:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:12:18.672580 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd86e0-e1e0-48dc-a896-da4f1a099f13 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:12:18.686478 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd86e0-e1e0-48dc-a896-da4f1a099f13 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:12:18.691475 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c3c67-f4f4-42f8-bdb2-4345d4609fd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:12:18.692076 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c3c67-f4f4-42f8-bdb2-4345d4609fd2 service nova] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:18.692355 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c3c67-f4f4-42f8-bdb2-4345d4609fd2 service nova] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:18.692626 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c3c67-f4f4-42f8-bdb2-4345d4609fd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:18.702033 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c3c67-f4f4-42f8-bdb2-4345d4609fd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:12:18.703751 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c3c67-f4f4-42f8-bdb2-4345d4609fd2 service nova] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:12:18.714299 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 507/1036] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:12:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:12:20.477798 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14743b10-86fb-414a-a402-73e65e47e603 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:20.478376 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14743b10-86fb-414a-a402-73e65e47e603 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:20.478376 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14743b10-86fb-414a-a402-73e65e47e603 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:20.479659 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 530/1037] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:12:20.485576 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0520a-012f-456e-83e4-c1c829d13ce0 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:20.485576 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0520a-012f-456e-83e4-c1c829d13ce0 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:20.486258 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0520a-012f-456e-83e4-c1c829d13ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:20.510864 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-80d0520a-012f-456e-83e4-c1c829d13ce0 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:12:20.512097 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-80d0520a-012f-456e-83e4-c1c829d13ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:12:20.520415 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 508/1038] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:12:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:12:20.682476 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14743b10-86fb-414a-a402-73e65e47e603 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:12:20.697333 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14743b10-86fb-414a-a402-73e65e47e603 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:12:20.703047 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb83b11-b73f-4152-97c5-50e967b18928 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:12:20.703640 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb83b11-b73f-4152-97c5-50e967b18928 service nova] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:20.703913 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb83b11-b73f-4152-97c5-50e967b18928 service nova] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:20.704182 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb83b11-b73f-4152-97c5-50e967b18928 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:20.712613 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb83b11-b73f-4152-97c5-50e967b18928 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:12:20.714214 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb83b11-b73f-4152-97c5-50e967b18928 service nova] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:12:20.724087 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 531/1039] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:12:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:12:22.541024 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b4876-c123-48fc-ac1d-c7cf814ea163 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:22.541710 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b4876-c123-48fc-ac1d-c7cf814ea163 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:22.541710 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b4876-c123-48fc-ac1d-c7cf814ea163 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:22.543169 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 509/1040] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:12:22.548942 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a399ceb-5160-4608-9ead-cbf10518be80 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:22.549477 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a399ceb-5160-4608-9ead-cbf10518be80 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:22.549692 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a399ceb-5160-4608-9ead-cbf10518be80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:22.570108 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-0a399ceb-5160-4608-9ead-cbf10518be80 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:12:22.571237 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-0a399ceb-5160-4608-9ead-cbf10518be80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:12:22.579442 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 532/1041] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:12:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:12:22.740655 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b4876-c123-48fc-ac1d-c7cf814ea163 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:12:22.754406 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b4876-c123-48fc-ac1d-c7cf814ea163 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:12:22.759163 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fe7c8-e886-4ad7-a5b0-6ef6b33ee266 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:12:22.759830 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fe7c8-e886-4ad7-a5b0-6ef6b33ee266 service nova] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:22.760108 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fe7c8-e886-4ad7-a5b0-6ef6b33ee266 service nova] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:22.760396 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fe7c8-e886-4ad7-a5b0-6ef6b33ee266 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:22.769624 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736fe7c8-e886-4ad7-a5b0-6ef6b33ee266 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:12:22.771234 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736fe7c8-e886-4ad7-a5b0-6ef6b33ee266 service nova] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:12:22.781923 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 510/1042] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:12:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:12:24.459701 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a9b35-84b4-4892-9988-c4fea028f390 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:24.460269 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a9b35-84b4-4892-9988-c4fea028f390 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:24.460269 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a9b35-84b4-4892-9988-c4fea028f390 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:24.461588 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 533/1043] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:12:24.466430 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6375b-358e-457d-96a5-f3facdf93633 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:24.466832 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6375b-358e-457d-96a5-f3facdf93633 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:24.467483 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6375b-358e-457d-96a5-f3facdf93633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:24.488622 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-e5d6375b-358e-457d-96a5-f3facdf93633 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:12:24.489858 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-e5d6375b-358e-457d-96a5-f3facdf93633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:12:24.497844 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 511/1044] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:12:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:12:24.655956 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a9b35-84b4-4892-9988-c4fea028f390 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:12:24.669440 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a9b35-84b4-4892-9988-c4fea028f390 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:12:24.674922 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb3071-f201-4e15-b809-cd795770ab78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:12:24.675513 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb3071-f201-4e15-b809-cd795770ab78 service nova] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:24.675787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb3071-f201-4e15-b809-cd795770ab78 service nova] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:24.676051 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb3071-f201-4e15-b809-cd795770ab78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:24.684432 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb3071-f201-4e15-b809-cd795770ab78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:12:24.686201 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb3071-f201-4e15-b809-cd795770ab78 service nova] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:12:24.695553 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 534/1045] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:12:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:12:26.334464 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a71907-0b30-41ab-be2e-c645da4a7f2c None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:26.334930 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a71907-0b30-41ab-be2e-c645da4a7f2c None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:26.335057 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a71907-0b30-41ab-be2e-c645da4a7f2c None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:26.336423 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 512/1046] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:12:26.341456 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047b30c-7b0f-4aad-96cf-0b81a6bec3e0 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:26.342676 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047b30c-7b0f-4aad-96cf-0b81a6bec3e0 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:26.342676 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047b30c-7b0f-4aad-96cf-0b81a6bec3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:26.361562 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-2047b30c-7b0f-4aad-96cf-0b81a6bec3e0 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:12:26.362740 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-2047b30c-7b0f-4aad-96cf-0b81a6bec3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:12:26.370500 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 535/1047] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:12:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:12:26.526288 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a71907-0b30-41ab-be2e-c645da4a7f2c None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:12:26.540130 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a71907-0b30-41ab-be2e-c645da4a7f2c None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:12:26.544945 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af21a05-cedb-425f-80e2-2593b8967423 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:12:26.545588 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af21a05-cedb-425f-80e2-2593b8967423 service nova] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:26.545866 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af21a05-cedb-425f-80e2-2593b8967423 service nova] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:26.546135 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af21a05-cedb-425f-80e2-2593b8967423 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:26.554177 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af21a05-cedb-425f-80e2-2593b8967423 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:12:26.555739 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af21a05-cedb-425f-80e2-2593b8967423 service nova] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:12:26.565961 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 513/1048] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:12:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:12:28.177031 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bde233-2286-49e4-b63f-82c8b2a75367 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:28.177636 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bde233-2286-49e4-b63f-82c8b2a75367 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:28.177636 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bde233-2286-49e4-b63f-82c8b2a75367 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:28.178932 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 536/1049] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:12:28.184648 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609ada6-cab5-4042-b4ef-9741a441afdd None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:28.185165 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609ada6-cab5-4042-b4ef-9741a441afdd None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:28.185165 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609ada6-cab5-4042-b4ef-9741a441afdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:28.207376 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-9609ada6-cab5-4042-b4ef-9741a441afdd None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:12:28.208594 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-9609ada6-cab5-4042-b4ef-9741a441afdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:12:28.216385 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 514/1050] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:12:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:12:28.374365 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bde233-2286-49e4-b63f-82c8b2a75367 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:12:28.387780 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bde233-2286-49e4-b63f-82c8b2a75367 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:12:28.392909 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa11c87-534a-4b14-8dc3-9bfcf4d701df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:12:28.393527 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa11c87-534a-4b14-8dc3-9bfcf4d701df service nova] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:28.393809 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa11c87-534a-4b14-8dc3-9bfcf4d701df service nova] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:28.394082 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa11c87-534a-4b14-8dc3-9bfcf4d701df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:28.402208 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa11c87-534a-4b14-8dc3-9bfcf4d701df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:12:28.403787 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa11c87-534a-4b14-8dc3-9bfcf4d701df service nova] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:12:28.414100 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 537/1051] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:12:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:12:30.026762 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79f52f-dbc2-49a3-9af1-373a077ab6cf None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:30.027374 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79f52f-dbc2-49a3-9af1-373a077ab6cf None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:30.027374 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79f52f-dbc2-49a3-9af1-373a077ab6cf None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:30.028669 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 515/1052] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:12:30.034289 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1263b-3f5a-4a93-a8b9-f9430e2b6775 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:30.034837 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1263b-3f5a-4a93-a8b9-f9430e2b6775 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:30.034837 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1263b-3f5a-4a93-a8b9-f9430e2b6775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:30.056684 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-08d1263b-3f5a-4a93-a8b9-f9430e2b6775 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:12:30.057950 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-08d1263b-3f5a-4a93-a8b9-f9430e2b6775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:12:30.067212 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 538/1053] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:12:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:12:30.224985 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79f52f-dbc2-49a3-9af1-373a077ab6cf None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:12:30.239039 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79f52f-dbc2-49a3-9af1-373a077ab6cf None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:12:30.244121 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccef26a-439e-4136-b4ae-ab0867669628 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:12:30.244712 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccef26a-439e-4136-b4ae-ab0867669628 service nova] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:30.244988 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccef26a-439e-4136-b4ae-ab0867669628 service nova] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:30.245254 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccef26a-439e-4136-b4ae-ab0867669628 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:30.254344 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccef26a-439e-4136-b4ae-ab0867669628 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:12:30.255923 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccef26a-439e-4136-b4ae-ab0867669628 service nova] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:12:30.265389 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 516/1054] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:12:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:12:31.880457 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e01efc-64cf-4185-9532-ffd61c6cf34d None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:31.880996 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e01efc-64cf-4185-9532-ffd61c6cf34d None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:31.880996 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e01efc-64cf-4185-9532-ffd61c6cf34d None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:31.882238 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 539/1055] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:12:31.887228 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a367aa8-7150-4a01-bbc6-ec02f1207530 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:31.887704 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a367aa8-7150-4a01-bbc6-ec02f1207530 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:31.887815 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a367aa8-7150-4a01-bbc6-ec02f1207530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:31.908083 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-8a367aa8-7150-4a01-bbc6-ec02f1207530 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:12:31.909328 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-8a367aa8-7150-4a01-bbc6-ec02f1207530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:12:31.917085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 517/1056] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:12:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:12:32.074654 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e01efc-64cf-4185-9532-ffd61c6cf34d None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:12:32.087974 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e01efc-64cf-4185-9532-ffd61c6cf34d None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:12:32.093599 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec94b5-987b-40eb-bed8-650951f87d1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:12:32.094204 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec94b5-987b-40eb-bed8-650951f87d1b service nova] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:32.094474 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec94b5-987b-40eb-bed8-650951f87d1b service nova] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:32.094741 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec94b5-987b-40eb-bed8-650951f87d1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:32.103208 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec94b5-987b-40eb-bed8-650951f87d1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:12:32.104760 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec94b5-987b-40eb-bed8-650951f87d1b service nova] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:12:32.114899 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 540/1057] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:12:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:12:34.490552 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676566c-263c-48e3-9005-0b20de1bb98d None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:34.491302 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676566c-263c-48e3-9005-0b20de1bb98d None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:34.491302 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676566c-263c-48e3-9005-0b20de1bb98d None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:34.492455 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 518/1058] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:12:34.498072 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7ea61-09c9-44a3-ab62-659725bc7870 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:34.498551 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7ea61-09c9-44a3-ab62-659725bc7870 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:34.498776 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7ea61-09c9-44a3-ab62-659725bc7870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:34.518359 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-68c7ea61-09c9-44a3-ab62-659725bc7870 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:12:34.519576 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-68c7ea61-09c9-44a3-ab62-659725bc7870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:12:34.527304 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 541/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:12:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:12:34.872205 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676566c-263c-48e3-9005-0b20de1bb98d None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:12:34.883018 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676566c-263c-48e3-9005-0b20de1bb98d None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:12:34.886513 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af345190-a3d9-474d-a634-7c46a18a0b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:12:34.887109 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af345190-a3d9-474d-a634-7c46a18a0b21 service neutron] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:34.887391 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af345190-a3d9-474d-a634-7c46a18a0b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:34.887666 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af345190-a3d9-474d-a634-7c46a18a0b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:34.896464 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af345190-a3d9-474d-a634-7c46a18a0b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:12:34.897917 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af345190-a3d9-474d-a634-7c46a18a0b21 service neutron] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:12:34.907690 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 519/1060] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:12:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:12:37.550387 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99416c55-b94e-4c33-b35b-f9b3a0a7708c None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:37.550959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99416c55-b94e-4c33-b35b-f9b3a0a7708c None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:37.550959 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99416c55-b94e-4c33-b35b-f9b3a0a7708c None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:37.552284 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 542/1061] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:12:37.557391 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe3d3b-0b09-4ba0-9d6a-4805968d7b55 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:37.557811 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe3d3b-0b09-4ba0-9d6a-4805968d7b55 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:37.557943 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe3d3b-0b09-4ba0-9d6a-4805968d7b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:37.577771 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-cbbe3d3b-0b09-4ba0-9d6a-4805968d7b55 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:12:37.578899 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-cbbe3d3b-0b09-4ba0-9d6a-4805968d7b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:12:37.587342 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 520/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:12:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:12:37.928822 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99416c55-b94e-4c33-b35b-f9b3a0a7708c None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:12:37.940138 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99416c55-b94e-4c33-b35b-f9b3a0a7708c None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:12:37.943605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfd8e0-6378-4231-bae0-ae8f9a4203ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:12:37.944196 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfd8e0-6378-4231-bae0-ae8f9a4203ce service neutron] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:37.944468 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfd8e0-6378-4231-bae0-ae8f9a4203ce service neutron] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:37.944742 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfd8e0-6378-4231-bae0-ae8f9a4203ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:37.954586 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfd8e0-6378-4231-bae0-ae8f9a4203ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:12:37.956057 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfd8e0-6378-4231-bae0-ae8f9a4203ce service neutron] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:12:37.965806 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 543/1063] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:12:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:12:40.731852 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9417d-65fe-47bb-917a-92cf8d1e6652 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:40.732386 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9417d-65fe-47bb-917a-92cf8d1e6652 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:40.732386 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9417d-65fe-47bb-917a-92cf8d1e6652 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:40.733756 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 521/1064] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:12:40.739350 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22a7cb-7730-4396-8ab1-a5e4d042faee None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:40.739823 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22a7cb-7730-4396-8ab1-a5e4d042faee None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:40.739823 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22a7cb-7730-4396-8ab1-a5e4d042faee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:40.758880 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-bc22a7cb-7730-4396-8ab1-a5e4d042faee None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:12:40.760078 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-bc22a7cb-7730-4396-8ab1-a5e4d042faee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:12:40.768267 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 544/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:12:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:12:41.114873 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9417d-65fe-47bb-917a-92cf8d1e6652 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:12:41.125466 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9417d-65fe-47bb-917a-92cf8d1e6652 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:12:41.128922 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9d4af-8b6e-47b4-a203-118c9ce2229c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:12:41.129545 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9d4af-8b6e-47b4-a203-118c9ce2229c service neutron] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:41.129822 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9d4af-8b6e-47b4-a203-118c9ce2229c service neutron] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:41.130088 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9d4af-8b6e-47b4-a203-118c9ce2229c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:41.139144 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9d4af-8b6e-47b4-a203-118c9ce2229c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:12:41.140566 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9d4af-8b6e-47b4-a203-118c9ce2229c service neutron] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:12:41.149942 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 522/1066] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:12:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:12:43.672611 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23e3bb-46ab-4daf-809d-d3ee73419bee None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:43.673304 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23e3bb-46ab-4daf-809d-d3ee73419bee None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:43.673304 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23e3bb-46ab-4daf-809d-d3ee73419bee None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:43.674441 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 545/1067] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:12:43.680202 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5836607-394b-439f-89be-29ea852efd23 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:43.680685 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5836607-394b-439f-89be-29ea852efd23 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:43.680807 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5836607-394b-439f-89be-29ea852efd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:43.688894 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=60 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:12:43.703333 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-f5836607-394b-439f-89be-29ea852efd23 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:12:43.704547 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-f5836607-394b-439f-89be-29ea852efd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:12:43.712324 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 523/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:12:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:12:44.053863 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23e3bb-46ab-4daf-809d-d3ee73419bee None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:12:44.060030 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=55 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:12:44.067738 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23e3bb-46ab-4daf-809d-d3ee73419bee None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:12:44.071648 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de515ed-a2fd-4364-966d-c67769eef22c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:12:44.072270 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de515ed-a2fd-4364-966d-c67769eef22c service neutron] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:44.072545 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de515ed-a2fd-4364-966d-c67769eef22c service neutron] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:44.072815 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de515ed-a2fd-4364-966d-c67769eef22c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:44.083578 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de515ed-a2fd-4364-966d-c67769eef22c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:12:44.085024 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de515ed-a2fd-4364-966d-c67769eef22c service neutron] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:12:44.095642 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 546/1069] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:12:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:12:46.580170 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e159ca-82da-4428-8d1a-09c06887f7ee None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:46.580683 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e159ca-82da-4428-8d1a-09c06887f7ee None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:46.580683 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e159ca-82da-4428-8d1a-09c06887f7ee None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:46.582041 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 524/1070] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:12:46.587287 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6cb0b-8aa0-407b-824d-1273c0dd07cc None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:46.587759 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6cb0b-8aa0-407b-824d-1273c0dd07cc None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:46.587857 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6cb0b-8aa0-407b-824d-1273c0dd07cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:46.607062 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-59c6cb0b-8aa0-407b-824d-1273c0dd07cc None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:12:46.608778 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-59c6cb0b-8aa0-407b-824d-1273c0dd07cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:12:46.616636 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 547/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:12:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:12:46.960660 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e159ca-82da-4428-8d1a-09c06887f7ee None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:12:46.971805 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e159ca-82da-4428-8d1a-09c06887f7ee None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:12:46.975441 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a731c-8bb3-4f39-81ee-934408ff20a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:12:46.976031 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a731c-8bb3-4f39-81ee-934408ff20a8 service neutron] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:46.976303 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a731c-8bb3-4f39-81ee-934408ff20a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:46.976565 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a731c-8bb3-4f39-81ee-934408ff20a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:46.987906 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a731c-8bb3-4f39-81ee-934408ff20a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:12:46.989379 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a731c-8bb3-4f39-81ee-934408ff20a8 service neutron] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:12:46.999223 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 525/1072] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:12:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:12:49.512166 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ef338-ad50-423e-b4b7-31fe118d79b8 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:49.512704 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ef338-ad50-423e-b4b7-31fe118d79b8 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:49.512704 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ef338-ad50-423e-b4b7-31fe118d79b8 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:49.514111 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 548/1073] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:12:49.519240 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aeb3d1-aca6-46b2-bf03-fd82d8712bce None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:49.519639 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aeb3d1-aca6-46b2-bf03-fd82d8712bce None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:49.519780 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aeb3d1-aca6-46b2-bf03-fd82d8712bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:49.538432 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-d4aeb3d1-aca6-46b2-bf03-fd82d8712bce None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:12:49.539615 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-d4aeb3d1-aca6-46b2-bf03-fd82d8712bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:12:49.547694 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 526/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:12:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:12:49.883823 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ef338-ad50-423e-b4b7-31fe118d79b8 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:12:49.894695 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ef338-ad50-423e-b4b7-31fe118d79b8 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:12:49.898186 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0d0d3-b805-4e3d-8d03-749e5b0a4ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:12:49.898766 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0d0d3-b805-4e3d-8d03-749e5b0a4ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:49.899046 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0d0d3-b805-4e3d-8d03-749e5b0a4ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:49.899309 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0d0d3-b805-4e3d-8d03-749e5b0a4ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:49.908888 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0d0d3-b805-4e3d-8d03-749e5b0a4ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:12:49.910336 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0d0d3-b805-4e3d-8d03-749e5b0a4ff8 service neutron] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:12:49.921783 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 549/1075] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:12:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:12:52.394572 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14af36e-6105-4f20-8a6c-d2d641b0e2e0 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:52.395128 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14af36e-6105-4f20-8a6c-d2d641b0e2e0 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:52.395128 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14af36e-6105-4f20-8a6c-d2d641b0e2e0 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:52.396479 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 527/1076] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:12:52.401722 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d6fb1-76ea-4363-9d44-0d3fee6f7d4b None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:52.402145 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d6fb1-76ea-4363-9d44-0d3fee6f7d4b None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:52.402271 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d6fb1-76ea-4363-9d44-0d3fee6f7d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:52.422631 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-1f9d6fb1-76ea-4363-9d44-0d3fee6f7d4b None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:12:52.423828 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-1f9d6fb1-76ea-4363-9d44-0d3fee6f7d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:12:52.431643 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 550/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:12:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:12:52.770276 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14af36e-6105-4f20-8a6c-d2d641b0e2e0 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:12:52.781052 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14af36e-6105-4f20-8a6c-d2d641b0e2e0 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:12:52.784649 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c51da-8c51-4b1b-9199-8190d5a4fad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:12:52.785246 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c51da-8c51-4b1b-9199-8190d5a4fad0 service neutron] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:52.785553 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c51da-8c51-4b1b-9199-8190d5a4fad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:52.785818 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c51da-8c51-4b1b-9199-8190d5a4fad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:52.795009 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c51da-8c51-4b1b-9199-8190d5a4fad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:12:52.796970 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c51da-8c51-4b1b-9199-8190d5a4fad0 service neutron] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:12:52.806422 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 528/1078] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:12:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:12:55.315131 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b937d8-5bfe-415c-bb2b-8454085ec8bf None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:55.315678 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b937d8-5bfe-415c-bb2b-8454085ec8bf None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:55.315798 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b937d8-5bfe-415c-bb2b-8454085ec8bf None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:55.317032 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 551/1079] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:12:55.322623 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87301dd-f56e-4e4e-a3fa-d8f277838d76 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:55.323063 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87301dd-f56e-4e4e-a3fa-d8f277838d76 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:55.323173 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87301dd-f56e-4e4e-a3fa-d8f277838d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:55.342979 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-d87301dd-f56e-4e4e-a3fa-d8f277838d76 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:12:55.344173 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-d87301dd-f56e-4e4e-a3fa-d8f277838d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:12:55.351893 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 529/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:12:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:12:55.695420 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b937d8-5bfe-415c-bb2b-8454085ec8bf None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:12:55.707140 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b937d8-5bfe-415c-bb2b-8454085ec8bf None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:12:55.710616 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501dd5d-6ff5-428d-9e26-bffd2af89a46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:12:55.711208 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501dd5d-6ff5-428d-9e26-bffd2af89a46 service neutron] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:55.711486 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501dd5d-6ff5-428d-9e26-bffd2af89a46 service neutron] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:55.711753 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501dd5d-6ff5-428d-9e26-bffd2af89a46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:55.720738 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501dd5d-6ff5-428d-9e26-bffd2af89a46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:12:55.722196 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501dd5d-6ff5-428d-9e26-bffd2af89a46 service neutron] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:12:55.735993 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 552/1081] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:12:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:12:58.174222 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a477b-07c1-4182-8e8d-b39f2baab58b None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:58.174804 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a477b-07c1-4182-8e8d-b39f2baab58b None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:58.174804 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a477b-07c1-4182-8e8d-b39f2baab58b None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:58.176120 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 530/1082] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:12:58.181408 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6f765-0e6c-4f2f-8004-c0bf99f73e78 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:58.181863 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6f765-0e6c-4f2f-8004-c0bf99f73e78 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:58.181972 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6f765-0e6c-4f2f-8004-c0bf99f73e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:58.201003 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-d5b6f765-0e6c-4f2f-8004-c0bf99f73e78 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:12:58.202272 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-d5b6f765-0e6c-4f2f-8004-c0bf99f73e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:12:58.210184 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 553/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:12:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:12:58.552296 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a477b-07c1-4182-8e8d-b39f2baab58b None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:12:58.563210 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a477b-07c1-4182-8e8d-b39f2baab58b None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:12:58.566774 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd830fb-fc5a-41cd-bd84-a779e24b0b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:12:58.567389 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd830fb-fc5a-41cd-bd84-a779e24b0b11 service neutron] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:58.567663 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd830fb-fc5a-41cd-bd84-a779e24b0b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:58.567929 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd830fb-fc5a-41cd-bd84-a779e24b0b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:58.578471 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd830fb-fc5a-41cd-bd84-a779e24b0b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:12:58.579914 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd830fb-fc5a-41cd-bd84-a779e24b0b11 service neutron] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:12:58.590580 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 531/1084] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:12:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:13:01.027938 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43849cbf-9168-406d-b68e-0780dfda518c None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:01.028449 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43849cbf-9168-406d-b68e-0780dfda518c None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:01.028570 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43849cbf-9168-406d-b68e-0780dfda518c None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:01.030449 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 554/1085] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:13:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:13:01.035678 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0566fd-5b06-4864-9089-47dbe51c080b None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:01.036135 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0566fd-5b06-4864-9089-47dbe51c080b None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:01.036245 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0566fd-5b06-4864-9089-47dbe51c080b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:01.055097 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-be0566fd-5b06-4864-9089-47dbe51c080b None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:13:01.056295 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-be0566fd-5b06-4864-9089-47dbe51c080b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:13:01.064685 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 532/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:13:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:13:01.399027 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43849cbf-9168-406d-b68e-0780dfda518c None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:13:01.410315 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43849cbf-9168-406d-b68e-0780dfda518c None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:13:01.413802 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4daded-c52b-40c5-a3bb-fb6c6a8e5814 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:13:01.414392 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4daded-c52b-40c5-a3bb-fb6c6a8e5814 service neutron] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:01.414671 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4daded-c52b-40c5-a3bb-fb6c6a8e5814 service neutron] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:01.414947 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4daded-c52b-40c5-a3bb-fb6c6a8e5814 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:01.424499 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4daded-c52b-40c5-a3bb-fb6c6a8e5814 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:13:01.425952 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4daded-c52b-40c5-a3bb-fb6c6a8e5814 service neutron] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:13:01.435607 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 555/1087] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:13:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:13:11.050135 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=29 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:13:11.431123 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=32 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:13:26.791929 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cad9d1-48ec-49bb-be9d-f433f6d558aa None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:26.792551 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cad9d1-48ec-49bb-be9d-f433f6d558aa None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:26.792551 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cad9d1-48ec-49bb-be9d-f433f6d558aa None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:26.793883 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 533/1088] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:13:26.800989 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cea03-a473-460a-b3ae-b29c2f08352c None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:26.801619 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cea03-a473-460a-b3ae-b29c2f08352c None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:26.801619 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cea03-a473-460a-b3ae-b29c2f08352c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:26.822367 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-260cea03-a473-460a-b3ae-b29c2f08352c None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:13:26.823617 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-260cea03-a473-460a-b3ae-b29c2f08352c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:13:26.832233 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 556/1089] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:13:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:13:27.184496 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cd219-e8aa-4f3b-9745-93984d8e2a2c None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:27.184775 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cd219-e8aa-4f3b-9745-93984d8e2a2c None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:27.185046 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cd219-e8aa-4f3b-9745-93984d8e2a2c None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:27.187260 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 534/1090] 10.222.0.20 () {54 vars in 966 bytes} [Fri Sep 9 11:13:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:13:27.192639 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c3ca9-bb23-4f1d-b908-0acc979cc9c2 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:27.192919 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c3ca9-bb23-4f1d-b908-0acc979cc9c2 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:27.193187 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c3ca9-bb23-4f1d-b908-0acc979cc9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:27.212449 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-4f1c3ca9-bb23-4f1d-b908-0acc979cc9c2 None None] MFA Rules not processed for user `9d2e6375358545ac80db469ea4c2deb1`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:13:27.213681 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-4f1c3ca9-bb23-4f1d-b908-0acc979cc9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:13:27.219988 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 557/1091] 10.222.0.20 () {58 vars in 1063 bytes} [Fri Sep 9 11:13:27 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:13:27.227577 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cd219-e8aa-4f3b-9745-93984d8e2a2c None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:13:27.238831 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cd219-e8aa-4f3b-9745-93984d8e2a2c None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:13:27.242273 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bc929-1d5d-4786-b2c4-dee3fa03189e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d2e6375358545ac80db469ea4c2deb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:13:27.242866 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bc929-1d5d-4786-b2c4-dee3fa03189e service glance] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:27.243140 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bc929-1d5d-4786-b2c4-dee3fa03189e service glance] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:27.243403 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bc929-1d5d-4786-b2c4-dee3fa03189e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:27.253008 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5bc929-1d5d-4786-b2c4-dee3fa03189e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:13:27.254444 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5bc929-1d5d-4786-b2c4-dee3fa03189e service glance] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:13:27.263659 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 535/1092] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:13:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:13:29.820908 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b78f8-b009-48bf-b4b8-35f6fada6ded None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:29.821534 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b78f8-b009-48bf-b4b8-35f6fada6ded None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:29.821534 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b78f8-b009-48bf-b4b8-35f6fada6ded None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:29.822844 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 558/1093] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:13:29.829460 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235abbcb-d04f-438e-913e-7f7cbb2ea3ad None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:29.830053 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235abbcb-d04f-438e-913e-7f7cbb2ea3ad None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:29.830053 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235abbcb-d04f-438e-913e-7f7cbb2ea3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:29.850774 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-235abbcb-d04f-438e-913e-7f7cbb2ea3ad None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:13:29.852001 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-235abbcb-d04f-438e-913e-7f7cbb2ea3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:13:29.860104 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 536/1094] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:13:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:13:30.189339 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b78f8-b009-48bf-b4b8-35f6fada6ded None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:13:30.201706 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b78f8-b009-48bf-b4b8-35f6fada6ded None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:13:30.206088 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8dac0-6e37-476a-9045-1c6864ecbd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:13:30.206684 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8dac0-6e37-476a-9045-1c6864ecbd4e admin admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:30.206972 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8dac0-6e37-476a-9045-1c6864ecbd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:30.207240 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8dac0-6e37-476a-9045-1c6864ecbd4e admin admin] PATH_INFO: `/v3/projects` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:30.207874 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8dac0-6e37-476a-9045-1c6864ecbd4e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:13:30.209612 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: WARNING py.warnings [None req-0ad8dac0-6e37-476a-9045-1c6864ecbd4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:13:30.209612 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: warnings.warn(msg) Sep 09 11:13:30.209612 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: Sep 09 11:13:30.210755 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8dac0-6e37-476a-9045-1c6864ecbd4e admin admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:13:30.229238 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 559/1095] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 9 11:13:30 2022] GET /identity/v3/projects => generated 1606 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:13:32.663004 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1358227-6dc6-4631-9ef5-8d6a27ffd7ec None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:32.663537 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1358227-6dc6-4631-9ef5-8d6a27ffd7ec None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:32.663537 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1358227-6dc6-4631-9ef5-8d6a27ffd7ec None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:32.664779 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 537/1096] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:13:32.670914 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aed9c8-225c-4ae6-9d2a-b7af2f552b4d None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:32.671382 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aed9c8-225c-4ae6-9d2a-b7af2f552b4d None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:32.671490 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aed9c8-225c-4ae6-9d2a-b7af2f552b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:32.691647 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-09aed9c8-225c-4ae6-9d2a-b7af2f552b4d None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:13:32.692838 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-09aed9c8-225c-4ae6-9d2a-b7af2f552b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:13:32.700416 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 560/1097] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:13:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:13:33.045058 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1358227-6dc6-4631-9ef5-8d6a27ffd7ec None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:13:33.059107 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1358227-6dc6-4631-9ef5-8d6a27ffd7ec None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:13:33.064840 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9b113-a1d9-43e2-8e28-9c58c99cb47d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:13:33.065495 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9b113-a1d9-43e2-8e28-9c58c99cb47d service nova] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:33.065777 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9b113-a1d9-43e2-8e28-9c58c99cb47d service nova] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:33.066050 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9b113-a1d9-43e2-8e28-9c58c99cb47d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:33.075272 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9b113-a1d9-43e2-8e28-9c58c99cb47d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:13:33.077431 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9b113-a1d9-43e2-8e28-9c58c99cb47d service nova] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:13:33.087983 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 538/1098] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:13:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:13:35.695368 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532cb58-4a1c-46c9-a837-e253fbb54d75 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:35.695966 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532cb58-4a1c-46c9-a837-e253fbb54d75 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:35.695966 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532cb58-4a1c-46c9-a837-e253fbb54d75 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:35.697197 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 561/1099] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:13:35.703037 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41261d81-7072-4cd1-a26d-067461cabb8b None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:35.703449 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41261d81-7072-4cd1-a26d-067461cabb8b None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:35.703587 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41261d81-7072-4cd1-a26d-067461cabb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:35.722320 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-41261d81-7072-4cd1-a26d-067461cabb8b None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:13:35.723507 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-41261d81-7072-4cd1-a26d-067461cabb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:13:35.731470 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 539/1100] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:13:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:13:36.074017 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532cb58-4a1c-46c9-a837-e253fbb54d75 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:13:36.085042 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532cb58-4a1c-46c9-a837-e253fbb54d75 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:13:36.088489 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243957a-524f-4d5b-baba-cbd3b98e08a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:13:36.089084 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243957a-524f-4d5b-baba-cbd3b98e08a0 service neutron] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:36.089396 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243957a-524f-4d5b-baba-cbd3b98e08a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:36.089664 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243957a-524f-4d5b-baba-cbd3b98e08a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:36.099106 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243957a-524f-4d5b-baba-cbd3b98e08a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:13:36.100548 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243957a-524f-4d5b-baba-cbd3b98e08a0 service neutron] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:13:36.110187 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 562/1101] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:13:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:13:38.603496 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff69b9-353e-4ad4-8187-32214fd07b56 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:38.604029 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff69b9-353e-4ad4-8187-32214fd07b56 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:38.604029 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff69b9-353e-4ad4-8187-32214fd07b56 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:38.605266 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 540/1102] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:13:38.611104 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3ef54-fb30-4c30-b31a-f4350de089e1 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:38.611556 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3ef54-fb30-4c30-b31a-f4350de089e1 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:38.611664 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3ef54-fb30-4c30-b31a-f4350de089e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:38.631231 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-d8e3ef54-fb30-4c30-b31a-f4350de089e1 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:13:38.632430 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-d8e3ef54-fb30-4c30-b31a-f4350de089e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:13:38.640934 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 563/1103] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:13:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:13:38.986130 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff69b9-353e-4ad4-8187-32214fd07b56 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:13:38.997843 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff69b9-353e-4ad4-8187-32214fd07b56 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:13:39.002633 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5efa64a-1722-4a9d-bf2c-80a5d3ae1589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:13:39.003261 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efa64a-1722-4a9d-bf2c-80a5d3ae1589 service neutron] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:39.003521 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efa64a-1722-4a9d-bf2c-80a5d3ae1589 service neutron] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:39.003786 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efa64a-1722-4a9d-bf2c-80a5d3ae1589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:39.013245 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5efa64a-1722-4a9d-bf2c-80a5d3ae1589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:13:39.014853 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5efa64a-1722-4a9d-bf2c-80a5d3ae1589 service neutron] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:13:39.024174 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 541/1104] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:13:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:13:41.553665 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad43d1-89bd-444e-9b44-25de945d55d6 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:41.554227 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad43d1-89bd-444e-9b44-25de945d55d6 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:41.554227 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad43d1-89bd-444e-9b44-25de945d55d6 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:41.555722 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 564/1105] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:13:41.560912 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62f310-ec39-4e86-b500-2c15ff876fba None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:41.562213 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62f310-ec39-4e86-b500-2c15ff876fba None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:41.562213 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62f310-ec39-4e86-b500-2c15ff876fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:41.581348 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-ce62f310-ec39-4e86-b500-2c15ff876fba None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:13:41.582468 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-ce62f310-ec39-4e86-b500-2c15ff876fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:13:41.590107 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 542/1106] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:13:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:13:41.930645 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad43d1-89bd-444e-9b44-25de945d55d6 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:13:41.942712 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad43d1-89bd-444e-9b44-25de945d55d6 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:13:41.946314 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1c57b-4a1f-4187-89dc-8e00fd21b2e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:13:41.946904 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1c57b-4a1f-4187-89dc-8e00fd21b2e6 service neutron] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:41.947175 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1c57b-4a1f-4187-89dc-8e00fd21b2e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:41.947439 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1c57b-4a1f-4187-89dc-8e00fd21b2e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:41.956219 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c1c57b-4a1f-4187-89dc-8e00fd21b2e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:13:41.957649 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c1c57b-4a1f-4187-89dc-8e00fd21b2e6 service neutron] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:13:41.966661 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 565/1107] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:13:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:13:44.632735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577f2df-2d52-4bed-9a3b-e0d4387f893a None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:44.633261 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577f2df-2d52-4bed-9a3b-e0d4387f893a None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:44.633261 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577f2df-2d52-4bed-9a3b-e0d4387f893a None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:44.634674 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 543/1108] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 9 11:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:13:44.640738 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f8f3e-5498-4ca9-abb2-aad9a8603c74 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:44.641168 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f8f3e-5498-4ca9-abb2-aad9a8603c74 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:44.641307 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f8f3e-5498-4ca9-abb2-aad9a8603c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:44.660185 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-ca4f8f3e-5498-4ca9-abb2-aad9a8603c74 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:13:44.661423 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-ca4f8f3e-5498-4ca9-abb2-aad9a8603c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:13:44.669148 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 566/1109] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 9 11:13:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:13:45.014275 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577f2df-2d52-4bed-9a3b-e0d4387f893a None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:13:45.024746 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577f2df-2d52-4bed-9a3b-e0d4387f893a None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:13:45.028162 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc63b10-ca63-45ac-8304-91e1deaa1f73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:13:45.028751 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc63b10-ca63-45ac-8304-91e1deaa1f73 service neutron] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:45.029032 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc63b10-ca63-45ac-8304-91e1deaa1f73 service neutron] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:45.029346 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc63b10-ca63-45ac-8304-91e1deaa1f73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:45.038855 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc63b10-ca63-45ac-8304-91e1deaa1f73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:13:45.040310 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc63b10-ca63-45ac-8304-91e1deaa1f73 service neutron] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:13:45.050111 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 544/1110] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:13:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:13:54.655335 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=33 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:13:55.046074 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=33 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:15:04.179346 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d6297-eb80-449e-bbc8-b70db748b508 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:04.179974 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d6297-eb80-449e-bbc8-b70db748b508 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:04.179974 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d6297-eb80-449e-bbc8-b70db748b508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:04.258556 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-fc8d6297-eb80-449e-bbc8-b70db748b508 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:15:04.259703 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-fc8d6297-eb80-449e-bbc8-b70db748b508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:15:04.308594 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 567/1111] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 9 11:15:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:15:04.316806 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1947e0-a493-431a-b017-bf255ad3d712 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:04.317495 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1947e0-a493-431a-b017-bf255ad3d712 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:04.317495 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1947e0-a493-431a-b017-bf255ad3d712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:04.339125 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-2c1947e0-a493-431a-b017-bf255ad3d712 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:15:04.340374 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-2c1947e0-a493-431a-b017-bf255ad3d712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:15:04.348942 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 545/1112] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 9 11:15:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:15:04.353879 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d6297-eb80-449e-bbc8-b70db748b508 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:15:04.368261 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d6297-eb80-449e-bbc8-b70db748b508 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:15:04.373158 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a20e47-5efa-42ad-855e-fa3d10fbbe0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:15:04.373799 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a20e47-5efa-42ad-855e-fa3d10fbbe0d admin admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:04.374081 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a20e47-5efa-42ad-855e-fa3d10fbbe0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:04.374353 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a20e47-5efa-42ad-855e-fa3d10fbbe0d admin admin] PATH_INFO: `/v3/domains` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:04.374998 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a20e47-5efa-42ad-855e-fa3d10fbbe0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:15:04.375300 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a20e47-5efa-42ad-855e-fa3d10fbbe0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:15:04.376317 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: WARNING py.warnings [None req-57a20e47-5efa-42ad-855e-fa3d10fbbe0d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:15:04.376317 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: warnings.warn(msg) Sep 09 11:15:04.376317 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: Sep 09 11:15:04.377201 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a20e47-5efa-42ad-855e-fa3d10fbbe0d admin admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:15:04.390729 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 568/1113] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 9 11:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:15:04.399153 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1947e0-a493-431a-b017-bf255ad3d712 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:15:04.408913 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1947e0-a493-431a-b017-bf255ad3d712 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:15:04.413547 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccdc45-5d3d-4e64-ba62-3b88ac05b6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:15:04.414155 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccdc45-5d3d-4e64-ba62-3b88ac05b6af admin admin] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:04.414434 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccdc45-5d3d-4e64-ba62-3b88ac05b6af admin admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:04.414708 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccdc45-5d3d-4e64-ba62-3b88ac05b6af admin admin] PATH_INFO: `/v3/projects` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:04.415348 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fccdc45-5d3d-4e64-ba62-3b88ac05b6af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:15:04.417144 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: WARNING py.warnings [None req-5fccdc45-5d3d-4e64-ba62-3b88ac05b6af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:15:04.417144 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: warnings.warn(msg) Sep 09 11:15:04.417144 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: Sep 09 11:15:04.418378 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fccdc45-5d3d-4e64-ba62-3b88ac05b6af admin admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:15:04.457231 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 546/1114] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 9 11:15:04 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:15:04.461551 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a20e47-5efa-42ad-855e-fa3d10fbbe0d admin admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:15:04.472043 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a20e47-5efa-42ad-855e-fa3d10fbbe0d admin admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:15:04.530725 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d947f0-789b-4bdc-8eff-c96bd20bc4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:15:04.531331 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d947f0-789b-4bdc-8eff-c96bd20bc4cc admin admin] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:04.531611 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d947f0-789b-4bdc-8eff-c96bd20bc4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:04.531883 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d947f0-789b-4bdc-8eff-c96bd20bc4cc admin admin] PATH_INFO: `/v3/users` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:04.532507 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d947f0-789b-4bdc-8eff-c96bd20bc4cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:15:04.533538 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: WARNING py.warnings [None req-32d947f0-789b-4bdc-8eff-c96bd20bc4cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:15:04.533538 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: warnings.warn(msg) Sep 09 11:15:04.533538 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: Sep 09 11:15:04.534741 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d947f0-789b-4bdc-8eff-c96bd20bc4cc admin admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:15:04.556601 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 569/1115] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 9 11:15:04 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:15:04.560890 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccdc45-5d3d-4e64-ba62-3b88ac05b6af admin admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:15:04.571332 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccdc45-5d3d-4e64-ba62-3b88ac05b6af admin admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:15:04.576451 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac0679-2187-4b74-90c5-f2430ff5a10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:15:04.577041 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac0679-2187-4b74-90c5-f2430ff5a10b admin admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:04.577345 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac0679-2187-4b74-90c5-f2430ff5a10b admin admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:04.577618 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac0679-2187-4b74-90c5-f2430ff5a10b admin admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:04.578258 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac0679-2187-4b74-90c5-f2430ff5a10b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:15:04.579261 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: WARNING py.warnings [None req-c4ac0679-2187-4b74-90c5-f2430ff5a10b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:15:04.579261 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: warnings.warn(msg) Sep 09 11:15:04.579261 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: Sep 09 11:15:04.580142 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac0679-2187-4b74-90c5-f2430ff5a10b admin admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:15:04.595234 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 547/1116] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 9 11:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:15:04.599356 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d947f0-789b-4bdc-8eff-c96bd20bc4cc admin admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:15:04.609766 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d947f0-789b-4bdc-8eff-c96bd20bc4cc admin admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:15:04.614382 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c82d99-f682-4e92-b79f-e0efc60d91f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:15:04.614981 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c82d99-f682-4e92-b79f-e0efc60d91f7 admin admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:04.615247 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c82d99-f682-4e92-b79f-e0efc60d91f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:04.615514 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c82d99-f682-4e92-b79f-e0efc60d91f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:04.616143 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c82d99-f682-4e92-b79f-e0efc60d91f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:15:04.617132 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: WARNING py.warnings [None req-92c82d99-f682-4e92-b79f-e0efc60d91f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:15:04.617132 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: warnings.warn(msg) Sep 09 11:15:04.617132 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: Sep 09 11:15:04.618048 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c82d99-f682-4e92-b79f-e0efc60d91f7 admin admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:15:04.631050 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 570/1117] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 9 11:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:15:04.635333 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac0679-2187-4b74-90c5-f2430ff5a10b admin admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:15:04.646102 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac0679-2187-4b74-90c5-f2430ff5a10b admin admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:15:04.650717 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1e1fb-e183-4ddc-8c4b-18766142b8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:15:04.651366 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1e1fb-e183-4ddc-8c4b-18766142b8ca admin admin] REQUEST_METHOD: `PUT` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:04.651645 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1e1fb-e183-4ddc-8c4b-18766142b8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:04.651930 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1e1fb-e183-4ddc-8c4b-18766142b8ca admin admin] PATH_INFO: `/v3/projects/421b0092a56149cda8bec89201b2e9db/users/65471d8c3e0d48109115563b53041f65/roles/cf09a959c760483db0dff049f84e5482` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:04.666843 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1e1fb-e183-4ddc-8c4b-18766142b8ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=421b0092a56149cda8bec89201b2e9db, user_id=65471d8c3e0d48109115563b53041f65, role_id=cf09a959c760483db0dff049f84e5482)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:15:04.667870 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: WARNING py.warnings [None req-01c1e1fb-e183-4ddc-8c4b-18766142b8ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:15:04.667870 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: warnings.warn(msg) Sep 09 11:15:04.667870 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: Sep 09 11:15:04.669847 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1e1fb-e183-4ddc-8c4b-18766142b8ca admin admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:15:04.684569 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 548/1118] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 9 11:15:04 2022] PUT /identity/v3/projects/421b0092a56149cda8bec89201b2e9db/users/65471d8c3e0d48109115563b53041f65/roles/cf09a959c760483db0dff049f84e5482 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:15:04.697036 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f660f7b-03c1-4bac-be4c-8cd0b0ae1e51 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:04.697355 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f660f7b-03c1-4bac-be4c-8cd0b0ae1e51 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:04.697633 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f660f7b-03c1-4bac-be4c-8cd0b0ae1e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:04.726091 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-7f660f7b-03c1-4bac-be4c-8cd0b0ae1e51 None None] MFA Rules not processed for user `65471d8c3e0d48109115563b53041f65`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:15:04.727296 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-7f660f7b-03c1-4bac-be4c-8cd0b0ae1e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:15:04.758663 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:15:04.791807 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 571/1119] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 9 11:15:04 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:15:04.804942 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36370993-e584-430c-864f-b15ecd12f6f9 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:04.805220 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36370993-e584-430c-864f-b15ecd12f6f9 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:04.805506 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36370993-e584-430c-864f-b15ecd12f6f9 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:04.806810 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 549/1120] 10.222.0.20 () {54 vars in 964 bytes} [Fri Sep 9 11:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:15:04.812020 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c135bd5-336b-4ceb-ac6a-1da18f6d4c8e None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:04.812307 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c135bd5-336b-4ceb-ac6a-1da18f6d4c8e None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:04.812584 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c135bd5-336b-4ceb-ac6a-1da18f6d4c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:04.843288 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-3c135bd5-336b-4ceb-ac6a-1da18f6d4c8e None None] MFA Rules not processed for user `c779e851ccf2438594c450eb479c7717`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:15:04.844514 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-3c135bd5-336b-4ceb-ac6a-1da18f6d4c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:15:04.914090 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 572/1121] 10.222.0.20 () {58 vars in 1061 bytes} [Fri Sep 9 11:15:04 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:15:04.921786 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36370993-e584-430c-864f-b15ecd12f6f9 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:15:04.932360 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36370993-e584-430c-864f-b15ecd12f6f9 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:15:04.936365 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efbc068-ef3d-4862-8d09-4bfdd00e6ea7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c779e851ccf2438594c450eb479c7717', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:15:04.936954 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbc068-ef3d-4862-8d09-4bfdd00e6ea7 service cinder] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:04.937233 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbc068-ef3d-4862-8d09-4bfdd00e6ea7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:04.937531 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbc068-ef3d-4862-8d09-4bfdd00e6ea7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:04.945856 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efbc068-ef3d-4862-8d09-4bfdd00e6ea7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:15:04.947258 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efbc068-ef3d-4862-8d09-4bfdd00e6ea7 service cinder] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:15:04.956477 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 550/1122] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:15:04 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:15:04.994639 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ec962-bdd8-482a-abe4-4c3b9d0ec072 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:04.994930 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ec962-bdd8-482a-abe4-4c3b9d0ec072 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:04.995186 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ec962-bdd8-482a-abe4-4c3b9d0ec072 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:04.996489 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 573/1123] 10.222.0.20 () {52 vars in 830 bytes} [Fri Sep 9 11:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:15:05.001374 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efbc068-ef3d-4862-8d09-4bfdd00e6ea7 service cinder] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:15:05.071131 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efbc068-ef3d-4862-8d09-4bfdd00e6ea7 service cinder] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:15:05.076247 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d5dd6-ca84-457e-8436-10e75ab3433d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:15:05.076901 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d5dd6-ca84-457e-8436-10e75ab3433d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:05.077179 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d5dd6-ca84-457e-8436-10e75ab3433d admin admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:05.077484 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d5dd6-ca84-457e-8436-10e75ab3433d admin admin] PATH_INFO: `/v3/users/65471d8c3e0d48109115563b53041f65` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:05.078618 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d5dd6-ca84-457e-8436-10e75ab3433d admin admin] RBAC: Authorizing `identity:delete_user(user_id=65471d8c3e0d48109115563b53041f65)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:15:05.079623 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: WARNING py.warnings [None req-320d5dd6-ca84-457e-8436-10e75ab3433d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:15:05.079623 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: warnings.warn(msg) Sep 09 11:15:05.079623 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: Sep 09 11:15:05.080829 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d5dd6-ca84-457e-8436-10e75ab3433d admin admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:15:05.145607 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [None req-320d5dd6-ca84-457e-8436-10e75ab3433d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65471d8c3e0d48109115563b53041f65'} {{(pid=88463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:15:05.146250 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [None req-320d5dd6-ca84-457e-8436-10e75ab3433d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65471d8c3e0d48109115563b53041f65'} {{(pid=88463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:15:05.155857 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [None req-320d5dd6-ca84-457e-8436-10e75ab3433d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65471d8c3e0d48109115563b53041f65'} {{(pid=88463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:15:05.170058 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [None req-320d5dd6-ca84-457e-8436-10e75ab3433d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65471d8c3e0d48109115563b53041f65'} {{(pid=88463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:15:05.191432 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:15:05.194380 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [None req-320d5dd6-ca84-457e-8436-10e75ab3433d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65471d8c3e0d48109115563b53041f65'} {{(pid=88463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:15:05.201758 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 551/1124] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 9 11:15:04 2022] DELETE /identity/v3/users/65471d8c3e0d48109115563b53041f65 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:15:05.206195 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0542bb-6c8b-49ad-9abe-2d2a6b75450b None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:05.206679 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0542bb-6c8b-49ad-9abe-2d2a6b75450b None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:05.206774 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0542bb-6c8b-49ad-9abe-2d2a6b75450b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:05.225848 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-ed0542bb-6c8b-49ad-9abe-2d2a6b75450b None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:15:05.227063 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-ed0542bb-6c8b-49ad-9abe-2d2a6b75450b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:15:05.288397 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 574/1125] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 9 11:15:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:15:05.300041 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d5dd6-ca84-457e-8436-10e75ab3433d admin admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:15:05.301512 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-320d5dd6-ca84-457e-8436-10e75ab3433d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:15:05.359650 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d5dd6-ca84-457e-8436-10e75ab3433d admin admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:15:05.363214 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16bd23-aa7c-434f-b509-da6716a4f3c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:15:05.363828 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16bd23-aa7c-434f-b509-da6716a4f3c3 service neutron] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:05.364108 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16bd23-aa7c-434f-b509-da6716a4f3c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:05.364384 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16bd23-aa7c-434f-b509-da6716a4f3c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:05.374901 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16bd23-aa7c-434f-b509-da6716a4f3c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:15:05.376334 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16bd23-aa7c-434f-b509-da6716a4f3c3 service neutron] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:15:05.385976 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 552/1126] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:15:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:15:05.730432 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0542bb-6c8b-49ad-9abe-2d2a6b75450b None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:15:05.731984 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-ed0542bb-6c8b-49ad-9abe-2d2a6b75450b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:15:05.745203 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0542bb-6c8b-49ad-9abe-2d2a6b75450b None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:15:05.750096 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed05ddc-916c-4a23-bcdc-5e33881df63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:15:05.750891 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed05ddc-916c-4a23-bcdc-5e33881df63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:05.751174 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed05ddc-916c-4a23-bcdc-5e33881df63b admin admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:05.751450 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed05ddc-916c-4a23-bcdc-5e33881df63b admin admin] PATH_INFO: `/v3/projects/421b0092a56149cda8bec89201b2e9db` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:05.752649 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed05ddc-916c-4a23-bcdc-5e33881df63b admin admin] RBAC: Authorizing `identity:delete_project(project_id=421b0092a56149cda8bec89201b2e9db)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:15:05.753786 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: WARNING py.warnings [None req-9ed05ddc-916c-4a23-bcdc-5e33881df63b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:15:05.753786 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: warnings.warn(msg) Sep 09 11:15:05.753786 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: Sep 09 11:15:05.755347 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed05ddc-916c-4a23-bcdc-5e33881df63b admin admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:15:05.818804 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [None req-9ed05ddc-916c-4a23-bcdc-5e33881df63b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '421b0092a56149cda8bec89201b2e9db', 'request_id': 'req-9ed05ddc-916c-4a23-bcdc-5e33881df63b'} {{(pid=88462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:15:05.824679 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:15:05.831001 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [None req-9ed05ddc-916c-4a23-bcdc-5e33881df63b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '421b0092a56149cda8bec89201b2e9db', 'request_id': 'req-9ed05ddc-916c-4a23-bcdc-5e33881df63b'} {{(pid=88462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:15:05.838836 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [None req-9ed05ddc-916c-4a23-bcdc-5e33881df63b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '421b0092a56149cda8bec89201b2e9db', 'request_id': 'req-9ed05ddc-916c-4a23-bcdc-5e33881df63b'} {{(pid=88462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:15:05.858264 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [None req-9ed05ddc-916c-4a23-bcdc-5e33881df63b admin admin] The token cache is being invalidate because project 421b0092a56149cda8bec89201b2e9db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:15:05.858554 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [None req-9ed05ddc-916c-4a23-bcdc-5e33881df63b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:15:05.859202 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [None req-9ed05ddc-916c-4a23-bcdc-5e33881df63b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:15:05.860786 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 575/1127] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 9 11:15:05 2022] DELETE /identity/v3/projects/421b0092a56149cda8bec89201b2e9db => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:15:15.381648 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:15:15.854533 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=6,keystone:DELETE=2 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:16:29.876330 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4da07-a347-484c-8b15-eb8b364cbb6c None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:16:29.876952 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4da07-a347-484c-8b15-eb8b364cbb6c None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:16:29.876952 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4da07-a347-484c-8b15-eb8b364cbb6c None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:16:29.878281 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 553/1128] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:16:29.886854 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308df66-ab2f-4ad4-afa4-fe347c5e1de5 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:16:29.887428 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308df66-ab2f-4ad4-afa4-fe347c5e1de5 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:16:29.887428 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308df66-ab2f-4ad4-afa4-fe347c5e1de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:16:29.908388 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-3308df66-ab2f-4ad4-afa4-fe347c5e1de5 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:16:29.909730 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-3308df66-ab2f-4ad4-afa4-fe347c5e1de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:16:29.971032 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 576/1129] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:16:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:16:30.133843 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4da07-a347-484c-8b15-eb8b364cbb6c None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:16:30.135597 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-d3a4da07-a347-484c-8b15-eb8b364cbb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:16:30.232676 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4da07-a347-484c-8b15-eb8b364cbb6c None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:16:30.237896 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19b042-2c23-456a-af26-55fc633670af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:16:30.238617 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19b042-2c23-456a-af26-55fc633670af service nova] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:16:30.238989 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19b042-2c23-456a-af26-55fc633670af service nova] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:16:30.239375 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19b042-2c23-456a-af26-55fc633670af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:16:30.248257 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19b042-2c23-456a-af26-55fc633670af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:16:30.249888 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19b042-2c23-456a-af26-55fc633670af service nova] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:16:30.259841 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 554/1130] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:16:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:16:31.941853 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6a947-cba8-4be1-ab05-422febe833b3 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:16:31.942456 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6a947-cba8-4be1-ab05-422febe833b3 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:16:31.942456 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6a947-cba8-4be1-ab05-422febe833b3 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:16:31.943810 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 577/1131] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:16:31.949082 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695e536-f967-4b63-bd0c-8b5d70bbc47e None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:16:31.949576 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695e536-f967-4b63-bd0c-8b5d70bbc47e None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:16:31.949673 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695e536-f967-4b63-bd0c-8b5d70bbc47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:16:31.971125 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-5695e536-f967-4b63-bd0c-8b5d70bbc47e None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:16:31.972333 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-5695e536-f967-4b63-bd0c-8b5d70bbc47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:16:31.980544 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 555/1132] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:16:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:16:32.140149 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6a947-cba8-4be1-ab05-422febe833b3 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:16:32.153857 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6a947-cba8-4be1-ab05-422febe833b3 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:16:32.158835 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae7392-eda8-4ff8-98ab-36ae4150731b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:16:32.159837 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae7392-eda8-4ff8-98ab-36ae4150731b service nova] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:16:32.160099 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae7392-eda8-4ff8-98ab-36ae4150731b service nova] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:16:32.160404 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae7392-eda8-4ff8-98ab-36ae4150731b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:16:32.174612 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae7392-eda8-4ff8-98ab-36ae4150731b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:16:32.176206 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae7392-eda8-4ff8-98ab-36ae4150731b service nova] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:16:32.187068 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 578/1133] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:16:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:16:34.788511 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6768f2-0326-4173-a85d-8e7eb2377d06 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:16:34.789098 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6768f2-0326-4173-a85d-8e7eb2377d06 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:16:34.789098 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6768f2-0326-4173-a85d-8e7eb2377d06 None None] PATH_INFO: `/v3` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:16:34.790991 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 556/1134] 10.222.0.59 () {54 vars in 925 bytes} [Fri Sep 9 11:16:34 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:16:34.797031 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd22f7-f98d-4113-924f-b5b70e4b0fff None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:16:34.797683 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd22f7-f98d-4113-924f-b5b70e4b0fff None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:16:34.797683 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd22f7-f98d-4113-924f-b5b70e4b0fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:16:34.818990 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-80bd22f7-f98d-4113-924f-b5b70e4b0fff None None] MFA Rules not processed for user `ff72ca8bbc74499bb18ad4cb3ae2024c`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:16:34.820225 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-80bd22f7-f98d-4113-924f-b5b70e4b0fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:16:34.891858 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 579/1135] 10.222.0.59 () {58 vars in 1015 bytes} [Fri Sep 9 11:16:34 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:16:41.966219 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=40 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:16:43.413578 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdafe8-dd64-4af6-809e-f3287653c575 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:16:43.414182 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdafe8-dd64-4af6-809e-f3287653c575 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:16:43.414182 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdafe8-dd64-4af6-809e-f3287653c575 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:16:43.415617 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 557/1136] 10.222.0.20 () {54 vars in 961 bytes} [Fri Sep 9 11:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:16:43.421613 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b0c1d-20ca-4dcd-b716-5552d0993e0b None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:16:43.422149 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b0c1d-20ca-4dcd-b716-5552d0993e0b None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:16:43.422149 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b0c1d-20ca-4dcd-b716-5552d0993e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:16:43.442850 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-9a8b0c1d-20ca-4dcd-b716-5552d0993e0b None None] MFA Rules not processed for user `ff72ca8bbc74499bb18ad4cb3ae2024c`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:16:43.444074 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-9a8b0c1d-20ca-4dcd-b716-5552d0993e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:16:43.452956 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 580/1137] 10.222.0.20 () {58 vars in 1058 bytes} [Fri Sep 9 11:16:43 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:16:43.460594 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdafe8-dd64-4af6-809e-f3287653c575 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:16:43.475144 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdafe8-dd64-4af6-809e-f3287653c575 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:16:43.480328 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5ae28-21ec-48fc-af6e-360589ed5008 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff72ca8bbc74499bb18ad4cb3ae2024c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:16:43.481467 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5ae28-21ec-48fc-af6e-360589ed5008 service placement] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:16:43.481733 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5ae28-21ec-48fc-af6e-360589ed5008 service placement] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:16:43.482000 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5ae28-21ec-48fc-af6e-360589ed5008 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:16:43.490842 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c5ae28-21ec-48fc-af6e-360589ed5008 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:16:43.492559 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c5ae28-21ec-48fc-af6e-360589ed5008 service placement] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:16:43.504789 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 558/1138] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:16:43 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:16:44.282530 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81092615-2302-42f1-999d-5cfccde94543 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:16:44.283002 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81092615-2302-42f1-999d-5cfccde94543 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:16:44.283463 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81092615-2302-42f1-999d-5cfccde94543 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:16:44.285988 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 581/1139] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:16:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:16:44.291571 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f3717-0beb-45b5-a502-c37cdb8e086b None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:16:44.291901 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f3717-0beb-45b5-a502-c37cdb8e086b None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:16:44.292217 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f3717-0beb-45b5-a502-c37cdb8e086b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:16:44.316576 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-638f3717-0beb-45b5-a502-c37cdb8e086b None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:16:44.317886 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-638f3717-0beb-45b5-a502-c37cdb8e086b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:16:44.326409 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 559/1140] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:16:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:16:44.506080 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81092615-2302-42f1-999d-5cfccde94543 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:16:44.522038 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81092615-2302-42f1-999d-5cfccde94543 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:16:44.528428 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3890099-1a20-48e2-a3b6-c494aad0b5de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:16:44.529199 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3890099-1a20-48e2-a3b6-c494aad0b5de service nova] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:16:44.529624 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3890099-1a20-48e2-a3b6-c494aad0b5de service nova] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:16:44.530001 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3890099-1a20-48e2-a3b6-c494aad0b5de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:16:44.539741 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3890099-1a20-48e2-a3b6-c494aad0b5de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:16:44.541582 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3890099-1a20-48e2-a3b6-c494aad0b5de service nova] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:16:44.553703 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 582/1141] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:16:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:16:46.240063 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7327c-1d12-467d-af67-b0805002fa51 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:16:46.240769 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7327c-1d12-467d-af67-b0805002fa51 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:16:46.240769 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7327c-1d12-467d-af67-b0805002fa51 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:16:46.241964 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 560/1142] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:16:46.249901 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1112eeb-a87f-4c19-8f1e-87b3e9561e43 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:16:46.250501 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1112eeb-a87f-4c19-8f1e-87b3e9561e43 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:16:46.250501 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1112eeb-a87f-4c19-8f1e-87b3e9561e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:16:46.271897 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-b1112eeb-a87f-4c19-8f1e-87b3e9561e43 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:16:46.273148 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-b1112eeb-a87f-4c19-8f1e-87b3e9561e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:16:46.281718 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 583/1143] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:16:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:16:46.447610 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7327c-1d12-467d-af67-b0805002fa51 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:16:46.462595 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7327c-1d12-467d-af67-b0805002fa51 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:16:46.468409 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096ae10-6a8c-49a7-83b8-e91ab6e0400d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:16:46.469027 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096ae10-6a8c-49a7-83b8-e91ab6e0400d service nova] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:16:46.469336 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096ae10-6a8c-49a7-83b8-e91ab6e0400d service nova] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:16:46.469612 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096ae10-6a8c-49a7-83b8-e91ab6e0400d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:16:46.478554 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096ae10-6a8c-49a7-83b8-e91ab6e0400d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:16:46.480164 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096ae10-6a8c-49a7-83b8-e91ab6e0400d service nova] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:16:46.490727 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 561/1144] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:16:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:16:50.880460 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e593d2-9d09-4109-9e16-cbe6b102ef87 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:16:50.881069 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e593d2-9d09-4109-9e16-cbe6b102ef87 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:16:50.881069 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e593d2-9d09-4109-9e16-cbe6b102ef87 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:16:50.882390 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 584/1145] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:16:50.889568 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84738c4-48a6-4681-8e88-cebf11590303 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:16:50.890215 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84738c4-48a6-4681-8e88-cebf11590303 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:16:50.890505 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84738c4-48a6-4681-8e88-cebf11590303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:16:50.913223 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-c84738c4-48a6-4681-8e88-cebf11590303 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:16:50.914498 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-c84738c4-48a6-4681-8e88-cebf11590303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:16:50.923938 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 562/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:16:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:16:51.269342 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e593d2-9d09-4109-9e16-cbe6b102ef87 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:16:51.279371 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-a8e593d2-9d09-4109-9e16-cbe6b102ef87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:16:51.347942 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:16:51.354357 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e593d2-9d09-4109-9e16-cbe6b102ef87 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:16:51.358579 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8decb8-a627-49af-8ff3-6b5b84fe3249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:16:51.359177 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8decb8-a627-49af-8ff3-6b5b84fe3249 service neutron] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:16:51.359454 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8decb8-a627-49af-8ff3-6b5b84fe3249 service neutron] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:16:51.359744 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8decb8-a627-49af-8ff3-6b5b84fe3249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:16:51.369005 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8decb8-a627-49af-8ff3-6b5b84fe3249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:16:51.370448 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8decb8-a627-49af-8ff3-6b5b84fe3249 service neutron] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:16:51.379901 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 585/1147] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:16:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:16:53.868419 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449455e-aa11-4857-a874-4b103b28a2e5 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:16:53.868974 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449455e-aa11-4857-a874-4b103b28a2e5 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:16:53.868974 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449455e-aa11-4857-a874-4b103b28a2e5 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:16:53.870377 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 563/1148] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:16:53.877064 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e9966-056d-440d-bb62-b820afed943e None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:16:53.877663 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e9966-056d-440d-bb62-b820afed943e None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:16:53.877663 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e9966-056d-440d-bb62-b820afed943e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:16:53.897969 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-612e9966-056d-440d-bb62-b820afed943e None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:16:53.899189 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-612e9966-056d-440d-bb62-b820afed943e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:16:53.907119 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 586/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:16:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:16:54.259496 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449455e-aa11-4857-a874-4b103b28a2e5 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:16:54.262087 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-6449455e-aa11-4857-a874-4b103b28a2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:16:54.275559 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449455e-aa11-4857-a874-4b103b28a2e5 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:16:54.279498 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050aef5-1751-45f3-87b6-90d5b8928b37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:16:54.280092 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050aef5-1751-45f3-87b6-90d5b8928b37 service neutron] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:16:54.280365 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050aef5-1751-45f3-87b6-90d5b8928b37 service neutron] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:16:54.280658 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050aef5-1751-45f3-87b6-90d5b8928b37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:16:54.290125 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050aef5-1751-45f3-87b6-90d5b8928b37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:16:54.291581 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050aef5-1751-45f3-87b6-90d5b8928b37 service neutron] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:16:54.301826 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 564/1150] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:16:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:16:58.383113 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541e05c-e43e-437d-a099-a8e30c02695d None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:16:58.383674 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541e05c-e43e-437d-a099-a8e30c02695d None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:16:58.383674 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541e05c-e43e-437d-a099-a8e30c02695d None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:16:58.385008 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 587/1151] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:16:58.391713 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35d8ad-3f54-4515-a321-2a1170f23b87 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:16:58.392363 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35d8ad-3f54-4515-a321-2a1170f23b87 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:16:58.392363 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35d8ad-3f54-4515-a321-2a1170f23b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:16:58.412095 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-9d35d8ad-3f54-4515-a321-2a1170f23b87 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:16:58.413399 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-9d35d8ad-3f54-4515-a321-2a1170f23b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:16:58.421870 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 565/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:16:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:16:58.791202 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541e05c-e43e-437d-a099-a8e30c02695d None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:16:58.793015 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-0541e05c-e43e-437d-a099-a8e30c02695d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:16:58.868245 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541e05c-e43e-437d-a099-a8e30c02695d None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:16:58.872245 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4437708-7b5a-4ea8-8936-c92bb5bc877d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c779e851ccf2438594c450eb479c7717', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:16:58.872910 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4437708-7b5a-4ea8-8936-c92bb5bc877d service cinder] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:16:58.873232 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4437708-7b5a-4ea8-8936-c92bb5bc877d service cinder] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:16:58.873586 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4437708-7b5a-4ea8-8936-c92bb5bc877d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:16:58.883441 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4437708-7b5a-4ea8-8936-c92bb5bc877d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:16:58.884947 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4437708-7b5a-4ea8-8936-c92bb5bc877d service cinder] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:16:58.895501 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 588/1153] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:16:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:17:01.352186 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681b9dc-8443-41b9-8003-425db5a195f0 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:17:01.352757 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681b9dc-8443-41b9-8003-425db5a195f0 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:17:01.352850 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681b9dc-8443-41b9-8003-425db5a195f0 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:17:01.354267 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 566/1154] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:17:01.361870 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3db84-cdab-4684-a38e-245d567cb59b None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:17:01.362654 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3db84-cdab-4684-a38e-245d567cb59b None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:17:01.362814 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3db84-cdab-4684-a38e-245d567cb59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:17:01.382829 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-8bf3db84-cdab-4684-a38e-245d567cb59b None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:17:01.384046 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-8bf3db84-cdab-4684-a38e-245d567cb59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:17:01.393406 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 589/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:17:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:17:01.785001 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681b9dc-8443-41b9-8003-425db5a195f0 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:17:01.786689 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-f681b9dc-8443-41b9-8003-425db5a195f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:17:01.799588 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681b9dc-8443-41b9-8003-425db5a195f0 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:17:01.803109 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ecec98-039d-47a0-a4cc-93a9c57fea83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c779e851ccf2438594c450eb479c7717', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:17:01.803698 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecec98-039d-47a0-a4cc-93a9c57fea83 service cinder] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:17:01.803973 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecec98-039d-47a0-a4cc-93a9c57fea83 service cinder] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:17:01.804241 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecec98-039d-47a0-a4cc-93a9c57fea83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:17:01.813761 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ecec98-039d-47a0-a4cc-93a9c57fea83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:17:01.815184 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ecec98-039d-47a0-a4cc-93a9c57fea83 service cinder] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:17:01.825751 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 567/1156] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:17:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:17:11.377537 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=42 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:17:11.820825 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=33 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:18:20.131338 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b933b-6559-4095-9db5-ef0673ecb5c3 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:20.131999 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b933b-6559-4095-9db5-ef0673ecb5c3 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:20.132489 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b933b-6559-4095-9db5-ef0673ecb5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:20.146653 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d80dea-a913-41a7-8e9a-a6300bb7028c None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:20.147217 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d80dea-a913-41a7-8e9a-a6300bb7028c None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:20.147217 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d80dea-a913-41a7-8e9a-a6300bb7028c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:20.163814 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-779b933b-6559-4095-9db5-ef0673ecb5c3 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:18:20.165029 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-779b933b-6559-4095-9db5-ef0673ecb5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:18:20.169439 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-55d80dea-a913-41a7-8e9a-a6300bb7028c None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:18:20.171301 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-55d80dea-a913-41a7-8e9a-a6300bb7028c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:18:20.173761 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 590/1157] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 9 11:18:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:18:20.182595 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c47a2-6727-4f18-afea-6f77100b8b8b None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:20.182890 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c47a2-6727-4f18-afea-6f77100b8b8b None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:20.183162 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c47a2-6727-4f18-afea-6f77100b8b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:20.189323 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 568/1158] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 9 11:18:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:18:20.193678 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7e422-f0e6-4342-a750-db7d6078e50d None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:20.193959 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7e422-f0e6-4342-a750-db7d6078e50d None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:20.194228 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7e422-f0e6-4342-a750-db7d6078e50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:20.204275 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-c16c47a2-6727-4f18-afea-6f77100b8b8b None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:18:20.205536 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-c16c47a2-6727-4f18-afea-6f77100b8b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:18:20.214049 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 591/1159] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 9 11:18:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:18:20.214573 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-fcc7e422-f0e6-4342-a750-db7d6078e50d None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:18:20.215791 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-fcc7e422-f0e6-4342-a750-db7d6078e50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:18:20.218631 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c47a2-6727-4f18-afea-6f77100b8b8b None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:20.224243 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 569/1160] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 9 11:18:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:18:20.228500 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c47a2-6727-4f18-afea-6f77100b8b8b None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:20.228779 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7e422-f0e6-4342-a750-db7d6078e50d None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:20.233533 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f948657-9940-4517-8804-33cdeea14542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:20.234148 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f948657-9940-4517-8804-33cdeea14542 admin admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:20.234426 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f948657-9940-4517-8804-33cdeea14542 admin admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:20.234730 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f948657-9940-4517-8804-33cdeea14542 admin admin] PATH_INFO: `/v3/domains` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:20.235382 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f948657-9940-4517-8804-33cdeea14542 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:18:20.235690 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f948657-9940-4517-8804-33cdeea14542 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:20.237340 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f948657-9940-4517-8804-33cdeea14542 admin admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:20.238226 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7e422-f0e6-4342-a750-db7d6078e50d None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:20.243151 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4518d9-93aa-442e-a50b-b70aa68a8cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:20.243794 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4518d9-93aa-442e-a50b-b70aa68a8cbe admin admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:20.244074 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4518d9-93aa-442e-a50b-b70aa68a8cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:20.244350 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4518d9-93aa-442e-a50b-b70aa68a8cbe admin admin] PATH_INFO: `/v3/domains` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:20.245024 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4518d9-93aa-442e-a50b-b70aa68a8cbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:18:20.245354 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4518d9-93aa-442e-a50b-b70aa68a8cbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:20.246379 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: WARNING py.warnings [None req-eb4518d9-93aa-442e-a50b-b70aa68a8cbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:18:20.246379 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: warnings.warn(msg) Sep 09 11:18:20.246379 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: Sep 09 11:18:20.247264 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4518d9-93aa-442e-a50b-b70aa68a8cbe admin admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:20.249788 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 592/1161] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 9 11:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:18:20.258048 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f948657-9940-4517-8804-33cdeea14542 admin admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:20.274162 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 570/1162] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 9 11:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:18:20.274395 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f948657-9940-4517-8804-33cdeea14542 admin admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:20.275352 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4518d9-93aa-442e-a50b-b70aa68a8cbe admin admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:20.279139 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9d790-27f8-47d5-bf6a-f95f87e3b239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:20.279762 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9d790-27f8-47d5-bf6a-f95f87e3b239 admin admin] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:20.280052 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9d790-27f8-47d5-bf6a-f95f87e3b239 admin admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:20.280328 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9d790-27f8-47d5-bf6a-f95f87e3b239 admin admin] PATH_INFO: `/v3/projects` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:20.280974 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9d790-27f8-47d5-bf6a-f95f87e3b239 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:20.282050 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: WARNING py.warnings [None req-44a9d790-27f8-47d5-bf6a-f95f87e3b239 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:18:20.282050 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: warnings.warn(msg) Sep 09 11:18:20.282050 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: Sep 09 11:18:20.283271 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9d790-27f8-47d5-bf6a-f95f87e3b239 admin admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:20.287695 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4518d9-93aa-442e-a50b-b70aa68a8cbe admin admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:20.292823 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612779d-f497-44de-8dfb-f8795cc82c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:20.293464 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612779d-f497-44de-8dfb-f8795cc82c62 admin admin] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:20.293745 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612779d-f497-44de-8dfb-f8795cc82c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:20.294015 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612779d-f497-44de-8dfb-f8795cc82c62 admin admin] PATH_INFO: `/v3/projects` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:20.294653 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612779d-f497-44de-8dfb-f8795cc82c62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:20.296565 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612779d-f497-44de-8dfb-f8795cc82c62 admin admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:20.319159 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 593/1163] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 9 11:18:20 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:18:20.324141 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9d790-27f8-47d5-bf6a-f95f87e3b239 admin admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:20.336007 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 571/1164] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 9 11:18:20 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:18:20.341338 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612779d-f497-44de-8dfb-f8795cc82c62 admin admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:20.393185 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9d790-27f8-47d5-bf6a-f95f87e3b239 admin admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:20.416104 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612779d-f497-44de-8dfb-f8795cc82c62 admin admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:20.420736 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4990be8-3d63-4358-8161-2d97d0919f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:20.421387 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4990be8-3d63-4358-8161-2d97d0919f7f admin admin] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:20.421660 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4990be8-3d63-4358-8161-2d97d0919f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:20.421926 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4990be8-3d63-4358-8161-2d97d0919f7f admin admin] PATH_INFO: `/v3/users` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:20.422566 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4990be8-3d63-4358-8161-2d97d0919f7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:20.423588 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: WARNING py.warnings [None req-d4990be8-3d63-4358-8161-2d97d0919f7f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:18:20.423588 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: warnings.warn(msg) Sep 09 11:18:20.423588 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: Sep 09 11:18:20.424785 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4990be8-3d63-4358-8161-2d97d0919f7f admin admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:20.449336 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 572/1165] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 9 11:18:20 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:18:20.452263 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4990be8-3d63-4358-8161-2d97d0919f7f admin admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:20.456275 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1847e-2495-41ed-9ae8-45117a22b608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:20.456962 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1847e-2495-41ed-9ae8-45117a22b608 admin admin] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:20.457332 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1847e-2495-41ed-9ae8-45117a22b608 admin admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:20.457541 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1847e-2495-41ed-9ae8-45117a22b608 admin admin] PATH_INFO: `/v3/users` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:20.458180 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1847e-2495-41ed-9ae8-45117a22b608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:20.460114 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1847e-2495-41ed-9ae8-45117a22b608 admin admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:20.463098 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4990be8-3d63-4358-8161-2d97d0919f7f admin admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:20.468301 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bc456-c54a-4fb8-b5bc-6f886b74bcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:20.468911 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bc456-c54a-4fb8-b5bc-6f886b74bcf1 admin admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:20.469183 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bc456-c54a-4fb8-b5bc-6f886b74bcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:20.469504 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bc456-c54a-4fb8-b5bc-6f886b74bcf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:20.470194 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299bc456-c54a-4fb8-b5bc-6f886b74bcf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:20.471844 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299bc456-c54a-4fb8-b5bc-6f886b74bcf1 admin admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:20.482541 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 573/1166] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 9 11:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:18:20.486745 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bc456-c54a-4fb8-b5bc-6f886b74bcf1 admin admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:20.489358 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 594/1167] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 9 11:18:20 2022] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:18:20.491320 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1847e-2495-41ed-9ae8-45117a22b608 admin admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:20.496842 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bc456-c54a-4fb8-b5bc-6f886b74bcf1 admin admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:20.501523 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1847e-2495-41ed-9ae8-45117a22b608 admin admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:20.502004 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625eed1-b6f7-427d-a5ce-33968394337f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:20.502134 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625eed1-b6f7-427d-a5ce-33968394337f admin admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:20.502385 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625eed1-b6f7-427d-a5ce-33968394337f admin admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:20.502675 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625eed1-b6f7-427d-a5ce-33968394337f admin admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:20.503275 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625eed1-b6f7-427d-a5ce-33968394337f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:20.504866 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625eed1-b6f7-427d-a5ce-33968394337f admin admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:20.506533 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4d96e-f4e8-4351-a7e9-1ee7cc8f2782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:20.507143 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4d96e-f4e8-4351-a7e9-1ee7cc8f2782 admin admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:20.507427 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4d96e-f4e8-4351-a7e9-1ee7cc8f2782 admin admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:20.507696 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4d96e-f4e8-4351-a7e9-1ee7cc8f2782 admin admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:20.508339 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e4d96e-f4e8-4351-a7e9-1ee7cc8f2782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:20.510608 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e4d96e-f4e8-4351-a7e9-1ee7cc8f2782 admin admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:20.516661 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 574/1168] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 9 11:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:18:20.521177 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625eed1-b6f7-427d-a5ce-33968394337f admin admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:20.521371 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 595/1169] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 9 11:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:18:20.524995 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4d96e-f4e8-4351-a7e9-1ee7cc8f2782 admin admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:20.531542 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625eed1-b6f7-427d-a5ce-33968394337f admin admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:20.535791 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4d96e-f4e8-4351-a7e9-1ee7cc8f2782 admin admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:20.536097 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99594330-102e-418d-871a-4108bd43fa07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:20.536765 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99594330-102e-418d-871a-4108bd43fa07 admin admin] REQUEST_METHOD: `PUT` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:20.537035 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99594330-102e-418d-871a-4108bd43fa07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:20.537330 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99594330-102e-418d-871a-4108bd43fa07 admin admin] PATH_INFO: `/v3/projects/aa54cabbfbc44bbd98611ac527ad418d/users/3e47b03ce2fd45c7b4d63e93f0170b2e/roles/cf09a959c760483db0dff049f84e5482` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:20.540495 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05837c4-d816-407d-a3eb-a82c594baf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:20.541092 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05837c4-d816-407d-a3eb-a82c594baf57 admin admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:20.541460 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05837c4-d816-407d-a3eb-a82c594baf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:20.541732 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05837c4-d816-407d-a3eb-a82c594baf57 admin admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:20.542373 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05837c4-d816-407d-a3eb-a82c594baf57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:20.543979 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05837c4-d816-407d-a3eb-a82c594baf57 admin admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:20.553494 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99594330-102e-418d-871a-4108bd43fa07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa54cabbfbc44bbd98611ac527ad418d, user_id=3e47b03ce2fd45c7b4d63e93f0170b2e, role_id=cf09a959c760483db0dff049f84e5482)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:20.555165 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 596/1170] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 9 11:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:18:20.556167 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99594330-102e-418d-871a-4108bd43fa07 admin admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:20.559902 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05837c4-d816-407d-a3eb-a82c594baf57 admin admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:20.570387 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05837c4-d816-407d-a3eb-a82c594baf57 admin admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:20.571647 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 575/1171] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 9 11:18:20 2022] PUT /identity/v3/projects/aa54cabbfbc44bbd98611ac527ad418d/users/3e47b03ce2fd45c7b4d63e93f0170b2e/roles/cf09a959c760483db0dff049f84e5482 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:18:20.577253 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601289a-fcd8-41dc-9191-e57ade6d7a95 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:20.577621 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601289a-fcd8-41dc-9191-e57ade6d7a95 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:20.577945 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601289a-fcd8-41dc-9191-e57ade6d7a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:20.597584 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:18:20.603110 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-f601289a-fcd8-41dc-9191-e57ade6d7a95 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:18:20.604420 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-f601289a-fcd8-41dc-9191-e57ade6d7a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:18:20.642485 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bada2-d31d-4e54-9348-f13464bc3a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:20.643313 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bada2-d31d-4e54-9348-f13464bc3a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:20.643476 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bada2-d31d-4e54-9348-f13464bc3a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:20.643821 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bada2-d31d-4e54-9348-f13464bc3a49 admin admin] PATH_INFO: `/v3/projects/6224e833e8324eb094fbadccb5015f6f/users/9417de75e3034053a476ccf3aa311546/roles/cf09a959c760483db0dff049f84e5482` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:20.664203 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:18:20.665612 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7bada2-d31d-4e54-9348-f13464bc3a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6224e833e8324eb094fbadccb5015f6f, user_id=9417de75e3034053a476ccf3aa311546, role_id=cf09a959c760483db0dff049f84e5482)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:20.667168 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: WARNING py.warnings [None req-9d7bada2-d31d-4e54-9348-f13464bc3a49 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:18:20.667168 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: warnings.warn(msg) Sep 09 11:18:20.667168 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: Sep 09 11:18:20.671351 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7bada2-d31d-4e54-9348-f13464bc3a49 admin admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:20.678082 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 576/1172] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 9 11:18:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:18:20.686284 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 597/1173] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 9 11:18:20 2022] PUT /identity/v3/projects/6224e833e8324eb094fbadccb5015f6f/users/9417de75e3034053a476ccf3aa311546/roles/cf09a959c760483db0dff049f84e5482 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:18:20.688897 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601289a-fcd8-41dc-9191-e57ade6d7a95 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:20.691803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20012a-de52-4293-93e6-fd3c15f96bd1 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:20.692339 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20012a-de52-4293-93e6-fd3c15f96bd1 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:20.692655 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20012a-de52-4293-93e6-fd3c15f96bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:20.712988 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-6f20012a-de52-4293-93e6-fd3c15f96bd1 None None] MFA Rules not processed for user `07397da3682f4089a3c3c8d08484a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:18:20.714466 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-6f20012a-de52-4293-93e6-fd3c15f96bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:18:20.750317 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601289a-fcd8-41dc-9191-e57ade6d7a95 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:20.779083 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 598/1174] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 9 11:18:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:18:20.806268 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9db6e2-14c7-4efc-8f78-82c9b678e6eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:20.807429 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9db6e2-14c7-4efc-8f78-82c9b678e6eb service neutron] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:20.807706 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9db6e2-14c7-4efc-8f78-82c9b678e6eb service neutron] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:20.807978 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9db6e2-14c7-4efc-8f78-82c9b678e6eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:20.818600 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9db6e2-14c7-4efc-8f78-82c9b678e6eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:20.820071 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9db6e2-14c7-4efc-8f78-82c9b678e6eb service neutron] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:20.831858 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 577/1175] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:18:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:18:20.884494 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20012a-de52-4293-93e6-fd3c15f96bd1 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:20.894984 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20012a-de52-4293-93e6-fd3c15f96bd1 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:20.898624 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1158b26-3f8a-4d49-933d-eefa7395ef9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:20.899231 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1158b26-3f8a-4d49-933d-eefa7395ef9a service neutron] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:20.899512 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1158b26-3f8a-4d49-933d-eefa7395ef9a service neutron] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:20.899784 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1158b26-3f8a-4d49-933d-eefa7395ef9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:20.910210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1158b26-3f8a-4d49-933d-eefa7395ef9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:20.911728 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1158b26-3f8a-4d49-933d-eefa7395ef9a service neutron] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:20.921747 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 599/1176] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:18:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:18:26.071578 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfa604-c471-4be4-be8a-148c0705f91d None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:26.072168 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfa604-c471-4be4-be8a-148c0705f91d None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:26.072168 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfa604-c471-4be4-be8a-148c0705f91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:26.123754 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-24dfa604-c471-4be4-be8a-148c0705f91d None None] MFA Rules not processed for user `3e47b03ce2fd45c7b4d63e93f0170b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:18:26.125023 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-24dfa604-c471-4be4-be8a-148c0705f91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:18:26.247146 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 578/1177] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 9 11:18:26 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:18:26.251363 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1158b26-3f8a-4d49-933d-eefa7395ef9a service neutron] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:26.264354 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1158b26-3f8a-4d49-933d-eefa7395ef9a service neutron] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:26.271315 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62e560-084d-4139-b865-d2324c471fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:26.272019 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62e560-084d-4139-b865-d2324c471fff admin admin] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:26.272308 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62e560-084d-4139-b865-d2324c471fff admin admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:26.272583 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62e560-084d-4139-b865-d2324c471fff admin admin] PATH_INFO: `/v3/projects` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:26.273349 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62e560-084d-4139-b865-d2324c471fff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:26.277036 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d62e560-084d-4139-b865-d2324c471fff admin admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:26.341970 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfa604-c471-4be4-be8a-148c0705f91d None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:26.357243 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 600/1178] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 9 11:18:26 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:18:26.358536 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfa604-c471-4be4-be8a-148c0705f91d None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:26.470406 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:18:26.524589 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc0f6a-cb06-4f13-980e-598c686e5269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:26.526753 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc0f6a-cb06-4f13-980e-598c686e5269 admin admin] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:26.526854 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc0f6a-cb06-4f13-980e-598c686e5269 admin admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:26.527144 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc0f6a-cb06-4f13-980e-598c686e5269 admin admin] PATH_INFO: `/v3/users` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:26.527733 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc0f6a-cb06-4f13-980e-598c686e5269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:26.529810 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc0f6a-cb06-4f13-980e-598c686e5269 admin admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:26.576719 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 579/1179] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 9 11:18:26 2022] POST /identity/v3/users => generated 295 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:18:26.580680 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62e560-084d-4139-b865-d2324c471fff admin admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:26.604343 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62e560-084d-4139-b865-d2324c471fff admin admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:26.625200 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c4a31-b709-454b-96c3-2ee3f1dcfbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:26.626662 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c4a31-b709-454b-96c3-2ee3f1dcfbb5 admin admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:26.626948 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c4a31-b709-454b-96c3-2ee3f1dcfbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:26.627217 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c4a31-b709-454b-96c3-2ee3f1dcfbb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:26.627978 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c4a31-b709-454b-96c3-2ee3f1dcfbb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:26.629759 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c4a31-b709-454b-96c3-2ee3f1dcfbb5 admin admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:26.653894 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 601/1180] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 9 11:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:18:26.654899 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc0f6a-cb06-4f13-980e-598c686e5269 admin admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:26.685172 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc0f6a-cb06-4f13-980e-598c686e5269 admin admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:26.692484 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fa487-b549-46ca-840a-ae10886de069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:26.696505 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fa487-b549-46ca-840a-ae10886de069 admin admin] REQUEST_METHOD: `PUT` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:26.697111 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fa487-b549-46ca-840a-ae10886de069 admin admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:26.698243 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fa487-b549-46ca-840a-ae10886de069 admin admin] PATH_INFO: `/v3/projects/9194207950334d7cab0717409db66c83/users/21c8af6b7f6442ee88f7982f1fce8220/roles/b02ba8c157bf46f4a75cdab917db78db` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:26.735252 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601fa487-b549-46ca-840a-ae10886de069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9194207950334d7cab0717409db66c83, user_id=21c8af6b7f6442ee88f7982f1fce8220, role_id=b02ba8c157bf46f4a75cdab917db78db)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:26.739819 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601fa487-b549-46ca-840a-ae10886de069 admin admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:26.775531 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 580/1181] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 9 11:18:26 2022] PUT /identity/v3/projects/9194207950334d7cab0717409db66c83/users/21c8af6b7f6442ee88f7982f1fce8220/roles/b02ba8c157bf46f4a75cdab917db78db => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:18:26.777119 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c4a31-b709-454b-96c3-2ee3f1dcfbb5 admin admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:26.811832 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c4a31-b709-454b-96c3-2ee3f1dcfbb5 admin admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:26.979058 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c913f-efca-48c3-9f34-1382238fb9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:26.980312 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c913f-efca-48c3-9f34-1382238fb9ab admin admin] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:26.980723 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c913f-efca-48c3-9f34-1382238fb9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:26.981102 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c913f-efca-48c3-9f34-1382238fb9ab admin admin] PATH_INFO: `/v3/roles` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:26.982598 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c913f-efca-48c3-9f34-1382238fb9ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:26.984993 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c913f-efca-48c3-9f34-1382238fb9ab admin admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:26.995474 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:18:27.006253 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 602/1182] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 9 11:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:18:27.007883 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fa487-b549-46ca-840a-ae10886de069 admin admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:27.021694 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fa487-b549-46ca-840a-ae10886de069 admin admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:27.038063 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec307d6-543a-4554-b222-df0573ebb4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:27.038763 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec307d6-543a-4554-b222-df0573ebb4e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:27.039050 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec307d6-543a-4554-b222-df0573ebb4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:27.039414 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec307d6-543a-4554-b222-df0573ebb4e4 admin admin] PATH_INFO: `/v3/projects/9194207950334d7cab0717409db66c83/users/21c8af6b7f6442ee88f7982f1fce8220/roles/b02ba8c157bf46f4a75cdab917db78db` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:27.047517 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec307d6-543a-4554-b222-df0573ebb4e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9194207950334d7cab0717409db66c83, user_id=21c8af6b7f6442ee88f7982f1fce8220, role_id=b02ba8c157bf46f4a75cdab917db78db)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:27.050362 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec307d6-543a-4554-b222-df0573ebb4e4 admin admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:27.093371 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 581/1183] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 9 11:18:27 2022] PUT /identity/v3/projects/9194207950334d7cab0717409db66c83/users/21c8af6b7f6442ee88f7982f1fce8220/roles/b02ba8c157bf46f4a75cdab917db78db => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:18:27.202573 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd8ea4-8fdb-4b0b-9686-49ca5422fc53 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:27.203019 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd8ea4-8fdb-4b0b-9686-49ca5422fc53 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:27.203397 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd8ea4-8fdb-4b0b-9686-49ca5422fc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:27.256536 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-86cd8ea4-8fdb-4b0b-9686-49ca5422fc53 None None] MFA Rules not processed for user `9417de75e3034053a476ccf3aa311546`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:18:27.257825 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-86cd8ea4-8fdb-4b0b-9686-49ca5422fc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:18:27.461088 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 603/1184] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 9 11:18:27 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:18:27.462776 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec307d6-543a-4554-b222-df0573ebb4e4 admin admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:27.597775 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec307d6-543a-4554-b222-df0573ebb4e4 admin admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:27.604353 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8b051-ca9f-4bf4-81b2-4c356009186d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:27.605249 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8b051-ca9f-4bf4-81b2-4c356009186d admin admin] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:27.605655 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8b051-ca9f-4bf4-81b2-4c356009186d admin admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:27.606001 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8b051-ca9f-4bf4-81b2-4c356009186d admin admin] PATH_INFO: `/v3/projects` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:27.606885 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8b051-ca9f-4bf4-81b2-4c356009186d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:27.609335 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8b051-ca9f-4bf4-81b2-4c356009186d admin admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:27.659025 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 582/1185] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 9 11:18:27 2022] POST /identity/v3/projects => generated 383 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:18:27.662158 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd8ea4-8fdb-4b0b-9686-49ca5422fc53 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:27.675821 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd8ea4-8fdb-4b0b-9686-49ca5422fc53 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:27.778002 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516a953-25a8-42ec-bf2f-daee5fda1757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:27.778484 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516a953-25a8-42ec-bf2f-daee5fda1757 admin admin] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:27.778767 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516a953-25a8-42ec-bf2f-daee5fda1757 admin admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:27.779035 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516a953-25a8-42ec-bf2f-daee5fda1757 admin admin] PATH_INFO: `/v3/users` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:27.779678 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516a953-25a8-42ec-bf2f-daee5fda1757 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:27.781654 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516a953-25a8-42ec-bf2f-daee5fda1757 admin admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:27.810587 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 604/1186] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 9 11:18:27 2022] POST /identity/v3/users => generated 298 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:18:27.814983 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8b051-ca9f-4bf4-81b2-4c356009186d admin admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:27.832537 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8b051-ca9f-4bf4-81b2-4c356009186d admin admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:27.845323 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0037e65-b9cd-4afa-9722-da16ee7015d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:27.845323 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0037e65-b9cd-4afa-9722-da16ee7015d6 admin admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:27.845323 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0037e65-b9cd-4afa-9722-da16ee7015d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:27.845323 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0037e65-b9cd-4afa-9722-da16ee7015d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:27.846730 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0037e65-b9cd-4afa-9722-da16ee7015d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:27.848848 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0037e65-b9cd-4afa-9722-da16ee7015d6 admin admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:27.872719 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 583/1187] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 9 11:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:18:27.873586 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516a953-25a8-42ec-bf2f-daee5fda1757 admin admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:27.889991 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516a953-25a8-42ec-bf2f-daee5fda1757 admin admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:27.895258 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d169c6-e2ac-4dfc-accb-9d3b31d00f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:27.900861 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d169c6-e2ac-4dfc-accb-9d3b31d00f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:27.901233 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d169c6-e2ac-4dfc-accb-9d3b31d00f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:27.901719 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d169c6-e2ac-4dfc-accb-9d3b31d00f1c admin admin] PATH_INFO: `/v3/projects/f84fd4eecfbf4ca881d4bd2750aa1a49/users/57e94c46cf194672869564e7e878237b/roles/b02ba8c157bf46f4a75cdab917db78db` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:27.921691 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d169c6-e2ac-4dfc-accb-9d3b31d00f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f84fd4eecfbf4ca881d4bd2750aa1a49, user_id=57e94c46cf194672869564e7e878237b, role_id=b02ba8c157bf46f4a75cdab917db78db)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:27.924936 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d169c6-e2ac-4dfc-accb-9d3b31d00f1c admin admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:27.944977 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 605/1188] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 9 11:18:27 2022] PUT /identity/v3/projects/f84fd4eecfbf4ca881d4bd2750aa1a49/users/57e94c46cf194672869564e7e878237b/roles/b02ba8c157bf46f4a75cdab917db78db => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:18:27.949530 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0037e65-b9cd-4afa-9722-da16ee7015d6 admin admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:27.960508 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0037e65-b9cd-4afa-9722-da16ee7015d6 admin admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:28.031695 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c079fc8-7d43-4c58-9a44-f471b9b56519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:28.032312 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c079fc8-7d43-4c58-9a44-f471b9b56519 admin admin] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:28.032587 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c079fc8-7d43-4c58-9a44-f471b9b56519 admin admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:28.032854 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c079fc8-7d43-4c58-9a44-f471b9b56519 admin admin] PATH_INFO: `/v3/roles` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:28.033535 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c079fc8-7d43-4c58-9a44-f471b9b56519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:28.035146 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c079fc8-7d43-4c58-9a44-f471b9b56519 admin admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:28.049564 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 584/1189] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 9 11:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:18:28.052937 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d169c6-e2ac-4dfc-accb-9d3b31d00f1c admin admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:28.069012 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d169c6-e2ac-4dfc-accb-9d3b31d00f1c admin admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:28.076459 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60714e48-83d2-40ad-9517-dbf81944db24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:28.078038 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60714e48-83d2-40ad-9517-dbf81944db24 admin admin] REQUEST_METHOD: `PUT` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:28.078038 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60714e48-83d2-40ad-9517-dbf81944db24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:28.078296 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60714e48-83d2-40ad-9517-dbf81944db24 admin admin] PATH_INFO: `/v3/projects/f84fd4eecfbf4ca881d4bd2750aa1a49/users/57e94c46cf194672869564e7e878237b/roles/b02ba8c157bf46f4a75cdab917db78db` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:28.082060 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60714e48-83d2-40ad-9517-dbf81944db24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f84fd4eecfbf4ca881d4bd2750aa1a49, user_id=57e94c46cf194672869564e7e878237b, role_id=b02ba8c157bf46f4a75cdab917db78db)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:28.085456 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60714e48-83d2-40ad-9517-dbf81944db24 admin admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:28.100727 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 606/1190] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 9 11:18:28 2022] PUT /identity/v3/projects/f84fd4eecfbf4ca881d4bd2750aa1a49/users/57e94c46cf194672869564e7e878237b/roles/b02ba8c157bf46f4a75cdab917db78db => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:18:33.819273 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21444bf1-aa77-46d9-9fcb-685ba7d8dd0b None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:33.819935 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21444bf1-aa77-46d9-9fcb-685ba7d8dd0b None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:33.819935 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21444bf1-aa77-46d9-9fcb-685ba7d8dd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:33.845350 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:18:33.875722 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-21444bf1-aa77-46d9-9fcb-685ba7d8dd0b None None] MFA Rules not processed for user `21c8af6b7f6442ee88f7982f1fce8220`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:18:33.877216 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-21444bf1-aa77-46d9-9fcb-685ba7d8dd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:18:34.006087 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 585/1191] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 9 11:18:33 2022] POST /identity/v3/auth/tokens => generated 2881 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:18:34.015414 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60714e48-83d2-40ad-9517-dbf81944db24 admin admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:34.019870 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-60714e48-83d2-40ad-9517-dbf81944db24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:18:34.093578 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:18:34.135297 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60714e48-83d2-40ad-9517-dbf81944db24 admin admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:34.140416 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f8df3-80d8-4e6d-b984-f587f20dd05a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d2e6375358545ac80db469ea4c2deb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:34.141178 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f8df3-80d8-4e6d-b984-f587f20dd05a service glance] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:34.141559 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f8df3-80d8-4e6d-b984-f587f20dd05a service glance] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:34.141910 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f8df3-80d8-4e6d-b984-f587f20dd05a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:34.244548 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f8df3-80d8-4e6d-b984-f587f20dd05a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:34.246125 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f8df3-80d8-4e6d-b984-f587f20dd05a service glance] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:34.268620 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 607/1192] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:18:34 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:18:35.132190 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60a944-6f35-4166-bc92-dc62a0e75183 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:35.132968 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60a944-6f35-4166-bc92-dc62a0e75183 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:35.133110 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60a944-6f35-4166-bc92-dc62a0e75183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:35.167158 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-9b60a944-6f35-4166-bc92-dc62a0e75183 None None] MFA Rules not processed for user `57e94c46cf194672869564e7e878237b`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:18:35.168386 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-9b60a944-6f35-4166-bc92-dc62a0e75183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:18:35.270106 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 586/1193] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 9 11:18:35 2022] POST /identity/v3/auth/tokens => generated 2887 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:18:35.277439 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f8df3-80d8-4e6d-b984-f587f20dd05a service glance] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:35.288471 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f8df3-80d8-4e6d-b984-f587f20dd05a service glance] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:35.294383 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac334b7-d9cf-453d-ab90-6d57def35d8a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d2e6375358545ac80db469ea4c2deb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:35.295354 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac334b7-d9cf-453d-ab90-6d57def35d8a service glance] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:35.295803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac334b7-d9cf-453d-ab90-6d57def35d8a service glance] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:35.296228 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac334b7-d9cf-453d-ab90-6d57def35d8a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:35.391112 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac334b7-d9cf-453d-ab90-6d57def35d8a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:35.392880 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac334b7-d9cf-453d-ab90-6d57def35d8a service glance] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:35.404627 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 608/1194] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:18:35 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:18:43.742838 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab0d2f-3cc3-4d00-a293-f98ffb395d18 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:43.743458 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab0d2f-3cc3-4d00-a293-f98ffb395d18 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:43.743458 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab0d2f-3cc3-4d00-a293-f98ffb395d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:43.770890 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-94ab0d2f-3cc3-4d00-a293-f98ffb395d18 None None] MFA Rules not processed for user `9417de75e3034053a476ccf3aa311546`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:18:43.772747 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-94ab0d2f-3cc3-4d00-a293-f98ffb395d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:18:43.782357 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 587/1195] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 9 11:18:43 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:18:44.150124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a8138-d079-4b3c-81a2-7e4c49b06ae8 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:44.150645 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a8138-d079-4b3c-81a2-7e4c49b06ae8 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:44.150749 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a8138-d079-4b3c-81a2-7e4c49b06ae8 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:44.152874 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 609/1196] 10.222.0.20 () {54 vars in 962 bytes} [Fri Sep 9 11:18:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:18:44.159924 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb33730-d516-4228-b85a-22d82c53a0c7 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:44.159924 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb33730-d516-4228-b85a-22d82c53a0c7 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:44.159924 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb33730-d516-4228-b85a-22d82c53a0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:44.187484 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-adb33730-d516-4228-b85a-22d82c53a0c7 None None] MFA Rules not processed for user `417acfbae1244469961371115a42498e`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:18:44.188782 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-adb33730-d516-4228-b85a-22d82c53a0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:18:44.296230 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 588/1197] 10.222.0.20 () {58 vars in 1059 bytes} [Fri Sep 9 11:18:44 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:18:44.301689 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad32c16-02c4-4181-9d9c-d37d2dfc1679 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:44.302000 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad32c16-02c4-4181-9d9c-d37d2dfc1679 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:44.302384 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad32c16-02c4-4181-9d9c-d37d2dfc1679 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:44.303956 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 610/1198] 10.222.0.20 () {54 vars in 912 bytes} [Fri Sep 9 11:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:18:44.313854 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9150743-418e-4ecc-86af-9c0454ee5da6 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:44.314496 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9150743-418e-4ecc-86af-9c0454ee5da6 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:44.319911 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9150743-418e-4ecc-86af-9c0454ee5da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:44.339183 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=100 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:18:44.350274 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-d9150743-418e-4ecc-86af-9c0454ee5da6 None None] MFA Rules not processed for user `417acfbae1244469961371115a42498e`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:18:44.352077 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-d9150743-418e-4ecc-86af-9c0454ee5da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:18:44.373090 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 589/1199] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 9 11:18:44 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:18:44.385818 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad32c16-02c4-4181-9d9c-d37d2dfc1679 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:44.387693 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-bad32c16-02c4-4181-9d9c-d37d2dfc1679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:18:44.404652 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad32c16-02c4-4181-9d9c-d37d2dfc1679 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:44.408691 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5830abc9-950e-4c7d-b86c-23122e68f5b5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d2e6375358545ac80db469ea4c2deb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:44.409563 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830abc9-950e-4c7d-b86c-23122e68f5b5 service glance] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:44.409719 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830abc9-950e-4c7d-b86c-23122e68f5b5 service glance] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:44.409866 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5830abc9-950e-4c7d-b86c-23122e68f5b5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:44.432210 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830abc9-950e-4c7d-b86c-23122e68f5b5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:44.434495 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5830abc9-950e-4c7d-b86c-23122e68f5b5 service glance] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:44.452520 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 611/1200] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:18:44 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:18:44.867457 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2f834-0957-4e44-9023-e291c8970f26 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:44.867956 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2f834-0957-4e44-9023-e291c8970f26 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:44.868065 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2f834-0957-4e44-9023-e291c8970f26 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:44.870152 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 590/1201] 10.222.0.20 () {54 vars in 912 bytes} [Fri Sep 9 11:18:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:18:44.876474 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3353b2b-4eca-4686-b49d-a8c16b1fb9a6 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:44.876898 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3353b2b-4eca-4686-b49d-a8c16b1fb9a6 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:44.877301 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3353b2b-4eca-4686-b49d-a8c16b1fb9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:44.905791 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-c3353b2b-4eca-4686-b49d-a8c16b1fb9a6 None None] MFA Rules not processed for user `1693fd5ca6084609adcb148aa7d7a8d6`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:18:44.907103 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-c3353b2b-4eca-4686-b49d-a8c16b1fb9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:18:44.983553 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 612/1202] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 9 11:18:44 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:18:44.995976 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2f834-0957-4e44-9023-e291c8970f26 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:45.012194 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2f834-0957-4e44-9023-e291c8970f26 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:45.019375 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34b9e1-a235-4313-84c4-e7a6684895fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:45.020502 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34b9e1-a235-4313-84c4-e7a6684895fb service neutron] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:45.020846 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34b9e1-a235-4313-84c4-e7a6684895fb service neutron] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:45.021235 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34b9e1-a235-4313-84c4-e7a6684895fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:45.031968 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34b9e1-a235-4313-84c4-e7a6684895fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:45.033731 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34b9e1-a235-4313-84c4-e7a6684895fb service neutron] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:45.044739 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 591/1203] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:18:44 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:18:45.485685 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367bd81-feb4-4744-81a1-2e31f5f52061 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:45.486938 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367bd81-feb4-4744-81a1-2e31f5f52061 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:45.487394 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367bd81-feb4-4744-81a1-2e31f5f52061 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:45.493719 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 613/1204] 10.222.0.20 () {54 vars in 962 bytes} [Fri Sep 9 11:18:45 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:18:45.500485 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69706c81-2ed8-4c23-a66f-7a035c1029c0 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:45.500774 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69706c81-2ed8-4c23-a66f-7a035c1029c0 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:45.501043 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69706c81-2ed8-4c23-a66f-7a035c1029c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:45.528662 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367bd81-feb4-4744-81a1-2e31f5f52061 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:45.531357 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-69706c81-2ed8-4c23-a66f-7a035c1029c0 None None] MFA Rules not processed for user `417acfbae1244469961371115a42498e`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:18:45.532581 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-69706c81-2ed8-4c23-a66f-7a035c1029c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:18:45.549326 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 592/1205] 10.222.0.20 () {58 vars in 1059 bytes} [Fri Sep 9 11:18:45 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:18:45.552922 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af0334-f574-40c2-860b-8e2dc144369f None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:45.554579 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af0334-f574-40c2-860b-8e2dc144369f None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:45.557479 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af0334-f574-40c2-860b-8e2dc144369f None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:45.562074 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 593/1206] 10.222.0.20 () {54 vars in 912 bytes} [Fri Sep 9 11:18:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:18:45.565880 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32964a89-8421-4c91-a848-1cea47302028 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:45.566251 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32964a89-8421-4c91-a848-1cea47302028 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:45.566590 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32964a89-8421-4c91-a848-1cea47302028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:45.578115 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=100 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:18:45.599674 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-32964a89-8421-4c91-a848-1cea47302028 None None] MFA Rules not processed for user `417acfbae1244469961371115a42498e`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:18:45.601009 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-32964a89-8421-4c91-a848-1cea47302028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:18:45.611369 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 594/1207] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 9 11:18:45 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:18:45.624594 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32964a89-8421-4c91-a848-1cea47302028 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:45.636191 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32964a89-8421-4c91-a848-1cea47302028 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:45.640225 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f86a9-b019-4c6e-b99c-6d074e5b3fef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:45.640949 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f86a9-b019-4c6e-b99c-6d074e5b3fef service neutron] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:45.641323 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f86a9-b019-4c6e-b99c-6d074e5b3fef service neutron] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:45.641655 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f86a9-b019-4c6e-b99c-6d074e5b3fef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:45.655243 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f86a9-b019-4c6e-b99c-6d074e5b3fef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:45.657241 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f86a9-b019-4c6e-b99c-6d074e5b3fef service neutron] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:45.661160 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367bd81-feb4-4744-81a1-2e31f5f52061 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:45.669200 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3689da2-64c7-4b15-9096-e3d5755428df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff72ca8bbc74499bb18ad4cb3ae2024c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:45.670071 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3689da2-64c7-4b15-9096-e3d5755428df service placement] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:45.670357 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3689da2-64c7-4b15-9096-e3d5755428df service placement] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:45.670618 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3689da2-64c7-4b15-9096-e3d5755428df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:45.673005 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 595/1208] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:18:45 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:18:45.673166 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-a3689da2-64c7-4b15-9096-e3d5755428df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:18:45.708308 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3689da2-64c7-4b15-9096-e3d5755428df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:45.710371 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3689da2-64c7-4b15-9096-e3d5755428df service placement] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:45.724360 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 614/1209] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:18:45 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:18:55.664107 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=18 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:18:55.718035 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=28 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:18:55.765677 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5ae55-f2df-46bd-b3bb-e84c693d5007 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:55.765964 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5ae55-f2df-46bd-b3bb-e84c693d5007 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:55.766238 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5ae55-f2df-46bd-b3bb-e84c693d5007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:55.786482 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-79f5ae55-f2df-46bd-b3bb-e84c693d5007 None None] MFA Rules not processed for user `1693fd5ca6084609adcb148aa7d7a8d6`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:18:55.787667 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-79f5ae55-f2df-46bd-b3bb-e84c693d5007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:18:55.825997 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 596/1210] 10.222.0.59 () {58 vars in 1015 bytes} [Fri Sep 9 11:18:55 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:18:55.843524 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3689da2-64c7-4b15-9096-e3d5755428df service placement] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:55.855803 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3689da2-64c7-4b15-9096-e3d5755428df service placement] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:55.859649 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ca897-58a9-420a-86cc-e476fe07ebf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:55.860254 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ca897-58a9-420a-86cc-e476fe07ebf6 service neutron] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:55.860571 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ca897-58a9-420a-86cc-e476fe07ebf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:55.860854 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ca897-58a9-420a-86cc-e476fe07ebf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:55.868814 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ca897-58a9-420a-86cc-e476fe07ebf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:55.870289 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ca897-58a9-420a-86cc-e476fe07ebf6 service neutron] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:55.878591 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 615/1211] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:18:55 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:18:56.732317 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c82d0-e80d-41dc-a588-34448ec4d0e5 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:56.732891 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c82d0-e80d-41dc-a588-34448ec4d0e5 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:56.732891 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c82d0-e80d-41dc-a588-34448ec4d0e5 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:56.735597 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 597/1212] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 9 11:18:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:18:56.772309 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe234c0-0620-408d-97f3-b28c6978c503 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:56.772902 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe234c0-0620-408d-97f3-b28c6978c503 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:56.772902 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe234c0-0620-408d-97f3-b28c6978c503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:56.794086 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-cbe234c0-0620-408d-97f3-b28c6978c503 None None] MFA Rules not processed for user `417acfbae1244469961371115a42498e`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:18:56.795429 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-cbe234c0-0620-408d-97f3-b28c6978c503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:18:56.810131 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 616/1213] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 9 11:18:56 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:18:56.833847 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c82d0-e80d-41dc-a588-34448ec4d0e5 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:56.849218 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c82d0-e80d-41dc-a588-34448ec4d0e5 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:56.855266 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e636f-ac17-440d-93de-8bf385afdc2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:56.855559 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e636f-ac17-440d-93de-8bf385afdc2d service nova] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:56.855844 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e636f-ac17-440d-93de-8bf385afdc2d service nova] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:56.856269 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e636f-ac17-440d-93de-8bf385afdc2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:56.866793 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e636f-ac17-440d-93de-8bf385afdc2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:56.869246 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e636f-ac17-440d-93de-8bf385afdc2d service nova] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:56.894141 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 598/1214] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:18:56 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:19:03.078765 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98eea9c-e9d8-4fcb-a625-7cd2cc21dc91 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:19:03.079784 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98eea9c-e9d8-4fcb-a625-7cd2cc21dc91 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:19:03.080064 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98eea9c-e9d8-4fcb-a625-7cd2cc21dc91 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:19:03.081904 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 617/1215] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 9 11:19:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:19:03.090882 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3dc12-437f-414c-8ece-7777e1dfc0f0 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:19:03.091483 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3dc12-437f-414c-8ece-7777e1dfc0f0 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:19:03.091667 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3dc12-437f-414c-8ece-7777e1dfc0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:19:03.124058 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-d4b3dc12-437f-414c-8ece-7777e1dfc0f0 None None] MFA Rules not processed for user `417acfbae1244469961371115a42498e`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:19:03.126938 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-d4b3dc12-437f-414c-8ece-7777e1dfc0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:19:03.141841 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 599/1216] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 9 11:19:03 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:19:03.164124 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98eea9c-e9d8-4fcb-a625-7cd2cc21dc91 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:19:03.181906 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98eea9c-e9d8-4fcb-a625-7cd2cc21dc91 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:19:03.187050 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da7f53-6465-4e4f-bb1f-f0e608cd34f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:19:03.187670 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da7f53-6465-4e4f-bb1f-f0e608cd34f5 service nova] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:19:03.187953 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da7f53-6465-4e4f-bb1f-f0e608cd34f5 service nova] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:19:03.188228 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da7f53-6465-4e4f-bb1f-f0e608cd34f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:19:03.197708 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da7f53-6465-4e4f-bb1f-f0e608cd34f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:19:03.199281 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da7f53-6465-4e4f-bb1f-f0e608cd34f5 service nova] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:19:03.209298 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 618/1217] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:19:03 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:19:13.114020 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=12 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:19:13.205043 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=15 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:19:15.641759 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3dc12-437f-414c-8ece-7777e1dfc0f0 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:19:15.652737 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3dc12-437f-414c-8ece-7777e1dfc0f0 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:19:15.656398 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce8595-cdcd-4984-b0b8-647d3481d859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:19:15.657016 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce8595-cdcd-4984-b0b8-647d3481d859 service neutron] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:19:15.657301 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce8595-cdcd-4984-b0b8-647d3481d859 service neutron] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:19:15.657704 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce8595-cdcd-4984-b0b8-647d3481d859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:19:15.667992 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce8595-cdcd-4984-b0b8-647d3481d859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:19:15.669827 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce8595-cdcd-4984-b0b8-647d3481d859 service neutron] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:19:15.681712 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 600/1218] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:19:15 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:19:25.676011 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=6 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:19:35.516741 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ba473-7f77-45af-b205-98b20b6f4a66 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:19:35.517328 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ba473-7f77-45af-b205-98b20b6f4a66 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:19:35.517328 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ba473-7f77-45af-b205-98b20b6f4a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:19:35.536718 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-be1ba473-7f77-45af-b205-98b20b6f4a66 None None] MFA Rules not processed for user `3e47b03ce2fd45c7b4d63e93f0170b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:19:35.537956 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-be1ba473-7f77-45af-b205-98b20b6f4a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:19:35.545487 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 619/1219] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 9 11:19:35 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:19:35.849272 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108435c7-5414-4bf5-b2a5-855dc070d65b None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:19:35.849876 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108435c7-5414-4bf5-b2a5-855dc070d65b None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:19:35.849876 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108435c7-5414-4bf5-b2a5-855dc070d65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:19:35.869387 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-108435c7-5414-4bf5-b2a5-855dc070d65b None None] MFA Rules not processed for user `1693fd5ca6084609adcb148aa7d7a8d6`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:19:35.870491 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-108435c7-5414-4bf5-b2a5-855dc070d65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:19:35.876801 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 601/1220] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 9 11:19:35 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:19:35.889768 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ba473-7f77-45af-b205-98b20b6f4a66 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:19:35.900214 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ba473-7f77-45af-b205-98b20b6f4a66 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:19:35.903719 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376bdef-649f-4999-afc8-10b1c4877345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:19:35.904306 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376bdef-649f-4999-afc8-10b1c4877345 service neutron] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:19:35.904581 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376bdef-649f-4999-afc8-10b1c4877345 service neutron] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:19:35.904847 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376bdef-649f-4999-afc8-10b1c4877345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:19:35.911759 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376bdef-649f-4999-afc8-10b1c4877345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:19:35.913156 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376bdef-649f-4999-afc8-10b1c4877345 service neutron] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:19:35.921141 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 620/1221] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:19:35 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:19:45.864026 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=3 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:19:45.917941 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=9 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:20:01.126885 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f141c-d7da-4ce1-87fe-c2727693dcac None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:01.127387 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f141c-d7da-4ce1-87fe-c2727693dcac None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:01.127470 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f141c-d7da-4ce1-87fe-c2727693dcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:01.147205 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-6d3f141c-d7da-4ce1-87fe-c2727693dcac None None] MFA Rules not processed for user `3e47b03ce2fd45c7b4d63e93f0170b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:20:01.148418 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-6d3f141c-d7da-4ce1-87fe-c2727693dcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:20:01.155368 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 602/1222] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 9 11:20:01 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:20:11.141619 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=3 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:20:16.021630 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b6934-0da2-4e85-8b59-ed4c51208105 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:16.022126 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b6934-0da2-4e85-8b59-ed4c51208105 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:16.022564 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b6934-0da2-4e85-8b59-ed4c51208105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:16.042477 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-575b6934-0da2-4e85-8b59-ed4c51208105 None None] MFA Rules not processed for user `3e47b03ce2fd45c7b4d63e93f0170b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:20:16.043678 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-575b6934-0da2-4e85-8b59-ed4c51208105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:20:16.050447 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 621/1223] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 9 11:20:16 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:20:26.036987 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=3 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:21:15.879627 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9128a4d-bfe0-4d13-ac94-5275a0b11961 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:21:15.880197 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9128a4d-bfe0-4d13-ac94-5275a0b11961 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:21:15.880197 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9128a4d-bfe0-4d13-ac94-5275a0b11961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:21:15.899999 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-f9128a4d-bfe0-4d13-ac94-5275a0b11961 None None] MFA Rules not processed for user `3e47b03ce2fd45c7b4d63e93f0170b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:21:15.901800 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-f9128a4d-bfe0-4d13-ac94-5275a0b11961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:21:15.908408 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 603/1224] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 9 11:21:15 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:21:25.893955 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=3 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:21:28.806054 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b6934-0da2-4e85-8b59-ed4c51208105 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:21:28.825045 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b6934-0da2-4e85-8b59-ed4c51208105 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:21:28.828613 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98f08b-35a2-407e-ab80-7aa0d6587868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:21:28.829208 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98f08b-35a2-407e-ab80-7aa0d6587868 service neutron] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:21:28.829521 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98f08b-35a2-407e-ab80-7aa0d6587868 service neutron] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:21:28.829796 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98f08b-35a2-407e-ab80-7aa0d6587868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:21:28.838906 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98f08b-35a2-407e-ab80-7aa0d6587868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:21:28.840855 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98f08b-35a2-407e-ab80-7aa0d6587868 service neutron] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:21:28.850605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 622/1225] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:21:28 2022] GET /identity/v3/auth/tokens => generated 2881 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:21:38.846270 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=10 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:22:42.775949 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9128a4d-bfe0-4d13-ac94-5275a0b11961 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:22:42.803420 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9128a4d-bfe0-4d13-ac94-5275a0b11961 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:22:42.809697 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e0e6c-0798-42a6-8698-21af8a50a894 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff72ca8bbc74499bb18ad4cb3ae2024c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:22:42.810478 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e0e6c-0798-42a6-8698-21af8a50a894 service placement] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:22:42.811022 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e0e6c-0798-42a6-8698-21af8a50a894 service placement] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:22:42.811459 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e0e6c-0798-42a6-8698-21af8a50a894 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:22:42.823693 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e0e6c-0798-42a6-8698-21af8a50a894 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:22:42.825520 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e0e6c-0798-42a6-8698-21af8a50a894 service placement] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:22:42.839574 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 604/1226] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:22:42 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:22:52.831730 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=10 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:23:04.515650 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4348e8-b5e8-4f93-aa78-17afae788a52 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:23:04.516163 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4348e8-b5e8-4f93-aa78-17afae788a52 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:23:04.516251 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4348e8-b5e8-4f93-aa78-17afae788a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:23:04.535506 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-bd4348e8-b5e8-4f93-aa78-17afae788a52 None None] MFA Rules not processed for user `9417de75e3034053a476ccf3aa311546`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:23:04.536545 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-bd4348e8-b5e8-4f93-aa78-17afae788a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:23:04.543400 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 623/1227] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 9 11:23:04 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:23:14.529948 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=3 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:23:35.851719 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e0e6c-0798-42a6-8698-21af8a50a894 service placement] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:23:35.873393 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e0e6c-0798-42a6-8698-21af8a50a894 service placement] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:23:35.882497 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edb31a-c2db-459a-a467-8099f25520fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:23:35.883124 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edb31a-c2db-459a-a467-8099f25520fb service nova] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:23:35.883405 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edb31a-c2db-459a-a467-8099f25520fb service nova] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:23:35.883678 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edb31a-c2db-459a-a467-8099f25520fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:23:35.892742 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93edb31a-c2db-459a-a467-8099f25520fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:23:35.894434 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93edb31a-c2db-459a-a467-8099f25520fb service nova] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:23:35.904845 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 605/1228] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:23:35 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:23:40.898007 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7174bd4-cceb-4de8-9e28-e92c9d54d7c0 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:23:40.898865 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7174bd4-cceb-4de8-9e28-e92c9d54d7c0 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:23:40.899025 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7174bd4-cceb-4de8-9e28-e92c9d54d7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:23:40.920539 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-b7174bd4-cceb-4de8-9e28-e92c9d54d7c0 None None] MFA Rules not processed for user `3e47b03ce2fd45c7b4d63e93f0170b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:23:40.921826 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-b7174bd4-cceb-4de8-9e28-e92c9d54d7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:23:40.929440 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 624/1229] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 9 11:23:40 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:23:45.899741 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=10 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:23:46.525758 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edb31a-c2db-459a-a467-8099f25520fb service nova] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:23:46.534725 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edb31a-c2db-459a-a467-8099f25520fb service nova] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:23:46.538739 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f78a1-1d0b-486a-8127-8aeb2ed0b5e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:23:46.539390 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f78a1-1d0b-486a-8127-8aeb2ed0b5e7 service neutron] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:23:46.539853 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f78a1-1d0b-486a-8127-8aeb2ed0b5e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:23:46.540850 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f78a1-1d0b-486a-8127-8aeb2ed0b5e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:23:46.550664 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f78a1-1d0b-486a-8127-8aeb2ed0b5e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:23:46.552085 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f78a1-1d0b-486a-8127-8aeb2ed0b5e7 service neutron] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:23:46.562069 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 606/1230] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:23:46 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:23:47.742103 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7174bd4-cceb-4de8-9e28-e92c9d54d7c0 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:23:47.752345 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7174bd4-cceb-4de8-9e28-e92c9d54d7c0 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:23:47.755881 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87333f1-f00d-4e05-9af6-beffb734eab7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:23:47.756480 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87333f1-f00d-4e05-9af6-beffb734eab7 service neutron] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:23:47.756760 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87333f1-f00d-4e05-9af6-beffb734eab7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:23:47.757035 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87333f1-f00d-4e05-9af6-beffb734eab7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:23:47.766442 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87333f1-f00d-4e05-9af6-beffb734eab7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:23:47.767974 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87333f1-f00d-4e05-9af6-beffb734eab7 service neutron] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:23:47.778929 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 625/1231] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:23:47 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:23:56.557727 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=6 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:23:56.750560 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f78a1-1d0b-486a-8127-8aeb2ed0b5e7 service neutron] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:23:56.759525 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f78a1-1d0b-486a-8127-8aeb2ed0b5e7 service neutron] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:23:56.762821 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107f46f-9a75-48b8-a87c-d9b32cb82be9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:23:56.763430 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107f46f-9a75-48b8-a87c-d9b32cb82be9 service neutron] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:23:56.763706 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107f46f-9a75-48b8-a87c-d9b32cb82be9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:23:56.763978 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107f46f-9a75-48b8-a87c-d9b32cb82be9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:23:56.771403 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107f46f-9a75-48b8-a87c-d9b32cb82be9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:23:56.772823 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107f46f-9a75-48b8-a87c-d9b32cb82be9 service neutron] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:23:56.781435 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 607/1232] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:23:56 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:23:57.766943 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87333f1-f00d-4e05-9af6-beffb734eab7 service neutron] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:23:57.777442 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87333f1-f00d-4e05-9af6-beffb734eab7 service neutron] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:23:57.782558 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f65e5-0d6d-445c-8cdb-9311c6841e8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:23:57.783158 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f65e5-0d6d-445c-8cdb-9311c6841e8f service nova] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:23:57.783440 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f65e5-0d6d-445c-8cdb-9311c6841e8f service nova] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:23:57.783715 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f65e5-0d6d-445c-8cdb-9311c6841e8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:23:57.791684 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f65e5-0d6d-445c-8cdb-9311c6841e8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:23:57.793258 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f65e5-0d6d-445c-8cdb-9311c6841e8f service nova] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:23:57.802150 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 626/1233] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:23:57 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:24:06.777856 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=6 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:07.798252 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=15 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:48.567288 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107f46f-9a75-48b8-a87c-d9b32cb82be9 service neutron] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:48.587106 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107f46f-9a75-48b8-a87c-d9b32cb82be9 service neutron] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:48.594912 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07473ed7-acfc-4592-adab-fb5dab905e21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:48.595549 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07473ed7-acfc-4592-adab-fb5dab905e21 service nova] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:48.595832 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07473ed7-acfc-4592-adab-fb5dab905e21 service nova] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:48.596107 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07473ed7-acfc-4592-adab-fb5dab905e21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:48.607348 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07473ed7-acfc-4592-adab-fb5dab905e21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:48.609338 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07473ed7-acfc-4592-adab-fb5dab905e21 service nova] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:48.623070 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 608/1234] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:24:48 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:24:57.196279 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f65e5-0d6d-445c-8cdb-9311c6841e8f service nova] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:57.206423 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f65e5-0d6d-445c-8cdb-9311c6841e8f service nova] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:57.210153 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15433cb8-1db5-4114-8533-7ea3b1522237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:57.210795 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15433cb8-1db5-4114-8533-7ea3b1522237 service neutron] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:57.211077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15433cb8-1db5-4114-8533-7ea3b1522237 service neutron] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:57.211346 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15433cb8-1db5-4114-8533-7ea3b1522237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:57.288161 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15433cb8-1db5-4114-8533-7ea3b1522237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:57.289645 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15433cb8-1db5-4114-8533-7ea3b1522237 service neutron] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:57.316651 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 627/1235] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:24:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:24:58.616916 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=6 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:00.831120 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bc646-ecdb-41af-b38a-55288d912b49 None None] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:00.831786 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bc646-ecdb-41af-b38a-55288d912b49 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:00.831786 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bc646-ecdb-41af-b38a-55288d912b49 None None] PATH_INFO: `/` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:00.833007 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 609/1236] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 9 11:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:00.839237 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09785b75-dc83-4333-ba07-3261d57f57a5 None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:00.839696 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09785b75-dc83-4333-ba07-3261d57f57a5 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:00.839789 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09785b75-dc83-4333-ba07-3261d57f57a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:00.908451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-09785b75-dc83-4333-ba07-3261d57f57a5 None None] MFA Rules not processed for user `ff72ca8bbc74499bb18ad4cb3ae2024c`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:00.908451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-09785b75-dc83-4333-ba07-3261d57f57a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:00.920088 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 628/1237] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 9 11:25:00 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:25:00.932995 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14bc646-ecdb-41af-b38a-55288d912b49 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:00.947422 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14bc646-ecdb-41af-b38a-55288d912b49 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:00.952616 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef0139-e260-44dc-95f3-c0fdb09ef864 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff72ca8bbc74499bb18ad4cb3ae2024c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:00.953231 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef0139-e260-44dc-95f3-c0fdb09ef864 service placement] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:00.953544 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef0139-e260-44dc-95f3-c0fdb09ef864 service placement] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:00.953816 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef0139-e260-44dc-95f3-c0fdb09ef864 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:00.965975 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef0139-e260-44dc-95f3-c0fdb09ef864 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:00.967609 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef0139-e260-44dc-95f3-c0fdb09ef864 service placement] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:00.978595 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 610/1238] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:25:00 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:25:04.833194 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b0dba-fd72-4b67-9f33-e912ac9eab55 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:04.834241 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b0dba-fd72-4b67-9f33-e912ac9eab55 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:04.834241 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b0dba-fd72-4b67-9f33-e912ac9eab55 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:04.835774 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 629/1239] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 9 11:25:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:04.847082 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8099f-d9b6-4932-805a-9a2c8a07c87a None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:04.847643 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8099f-d9b6-4932-805a-9a2c8a07c87a None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:04.847731 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8099f-d9b6-4932-805a-9a2c8a07c87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:04.907258 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b0dba-fd72-4b67-9f33-e912ac9eab55 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:04.915480 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-d3e8099f-d9b6-4932-805a-9a2c8a07c87a None None] MFA Rules not processed for user `ff72ca8bbc74499bb18ad4cb3ae2024c`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:04.917403 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-d3e8099f-d9b6-4932-805a-9a2c8a07c87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:04.954472 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b0dba-fd72-4b67-9f33-e912ac9eab55 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:04.957186 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 611/1240] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 9 11:25:04 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:25:04.965337 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088dfa5-aa33-4207-b14c-c55c8d4438b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:04.966339 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088dfa5-aa33-4207-b14c-c55c8d4438b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:04.966745 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088dfa5-aa33-4207-b14c-c55c8d4438b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:04.967139 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088dfa5-aa33-4207-b14c-c55c8d4438b7 admin admin] PATH_INFO: `/v3/users/9417de75e3034053a476ccf3aa311546` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:04.969171 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088dfa5-aa33-4207-b14c-c55c8d4438b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9417de75e3034053a476ccf3aa311546)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:04.970896 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8099f-d9b6-4932-805a-9a2c8a07c87a None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:04.971951 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: WARNING py.warnings [None req-1088dfa5-aa33-4207-b14c-c55c8d4438b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:25:04.971951 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: warnings.warn(msg) Sep 09 11:25:04.971951 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: Sep 09 11:25:04.974183 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088dfa5-aa33-4207-b14c-c55c8d4438b7 admin admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:04.988842 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8099f-d9b6-4932-805a-9a2c8a07c87a None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:04.995346 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e508155-7df5-41b4-9297-73bbae635dfb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff72ca8bbc74499bb18ad4cb3ae2024c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:04.996488 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e508155-7df5-41b4-9297-73bbae635dfb service placement] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:04.997244 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e508155-7df5-41b4-9297-73bbae635dfb service placement] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:04.998063 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e508155-7df5-41b4-9297-73bbae635dfb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:05.015661 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e508155-7df5-41b4-9297-73bbae635dfb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:05.017854 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e508155-7df5-41b4-9297-73bbae635dfb service placement] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:05.032239 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 612/1241] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:25:04 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:25:05.070986 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [None req-1088dfa5-aa33-4207-b14c-c55c8d4438b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9417de75e3034053a476ccf3aa311546'} {{(pid=88462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:25:05.071708 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [None req-1088dfa5-aa33-4207-b14c-c55c8d4438b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9417de75e3034053a476ccf3aa311546'} {{(pid=88462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:25:05.080110 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [None req-1088dfa5-aa33-4207-b14c-c55c8d4438b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9417de75e3034053a476ccf3aa311546'} {{(pid=88462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:25:05.093909 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [None req-1088dfa5-aa33-4207-b14c-c55c8d4438b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9417de75e3034053a476ccf3aa311546'} {{(pid=88462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:25:05.117375 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [None req-1088dfa5-aa33-4207-b14c-c55c8d4438b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9417de75e3034053a476ccf3aa311546'} {{(pid=88462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:25:05.125637 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 630/1242] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 9 11:25:04 2022] DELETE /identity/v3/users/9417de75e3034053a476ccf3aa311546 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:25:05.328200 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e508155-7df5-41b4-9297-73bbae635dfb service placement] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:05.346769 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e508155-7df5-41b4-9297-73bbae635dfb service placement] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:05.428970 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc6a58-a1c1-4eb9-960a-5ec5c0b43b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:05.429843 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc6a58-a1c1-4eb9-960a-5ec5c0b43b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:05.430189 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc6a58-a1c1-4eb9-960a-5ec5c0b43b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:05.430449 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc6a58-a1c1-4eb9-960a-5ec5c0b43b36 admin admin] PATH_INFO: `/v3/projects/6224e833e8324eb094fbadccb5015f6f` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:05.432066 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc6a58-a1c1-4eb9-960a-5ec5c0b43b36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6224e833e8324eb094fbadccb5015f6f)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:05.433227 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: WARNING py.warnings [None req-a4fc6a58-a1c1-4eb9-960a-5ec5c0b43b36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:25:05.433227 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: warnings.warn(msg) Sep 09 11:25:05.433227 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: Sep 09 11:25:05.434632 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc6a58-a1c1-4eb9-960a-5ec5c0b43b36 admin admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:05.506584 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [None req-a4fc6a58-a1c1-4eb9-960a-5ec5c0b43b36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6224e833e8324eb094fbadccb5015f6f', 'request_id': 'req-a4fc6a58-a1c1-4eb9-960a-5ec5c0b43b36'} {{(pid=88463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:25:05.515394 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [None req-a4fc6a58-a1c1-4eb9-960a-5ec5c0b43b36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6224e833e8324eb094fbadccb5015f6f', 'request_id': 'req-a4fc6a58-a1c1-4eb9-960a-5ec5c0b43b36'} {{(pid=88463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:25:05.523161 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [None req-a4fc6a58-a1c1-4eb9-960a-5ec5c0b43b36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6224e833e8324eb094fbadccb5015f6f', 'request_id': 'req-a4fc6a58-a1c1-4eb9-960a-5ec5c0b43b36'} {{(pid=88463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:25:05.556197 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:05.559891 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [None req-a4fc6a58-a1c1-4eb9-960a-5ec5c0b43b36 admin admin] The token cache is being invalidate because project 6224e833e8324eb094fbadccb5015f6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:25:05.560444 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [None req-a4fc6a58-a1c1-4eb9-960a-5ec5c0b43b36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:25:05.561727 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [None req-a4fc6a58-a1c1-4eb9-960a-5ec5c0b43b36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:25:05.563778 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 613/1243] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 9 11:25:05 2022] DELETE /identity/v3/projects/6224e833e8324eb094fbadccb5015f6f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:25:05.568072 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088dfa5-aa33-4207-b14c-c55c8d4438b7 admin admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:05.569723 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-1088dfa5-aa33-4207-b14c-c55c8d4438b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:05.581122 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:05.588055 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088dfa5-aa33-4207-b14c-c55c8d4438b7 admin admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:05.669575 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaadcf5-15d9-43a0-a05e-fd0d6611cabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:05.670228 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaadcf5-15d9-43a0-a05e-fd0d6611cabf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:05.670513 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaadcf5-15d9-43a0-a05e-fd0d6611cabf admin admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:05.670819 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaadcf5-15d9-43a0-a05e-fd0d6611cabf admin admin] PATH_INFO: `/v3/users/57e94c46cf194672869564e7e878237b` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:05.672054 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaadcf5-15d9-43a0-a05e-fd0d6611cabf admin admin] RBAC: Authorizing `identity:delete_user(user_id=57e94c46cf194672869564e7e878237b)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:05.674221 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaadcf5-15d9-43a0-a05e-fd0d6611cabf admin admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:05.731846 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [None req-bfaadcf5-15d9-43a0-a05e-fd0d6611cabf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57e94c46cf194672869564e7e878237b'} {{(pid=88462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:25:05.732816 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [None req-bfaadcf5-15d9-43a0-a05e-fd0d6611cabf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57e94c46cf194672869564e7e878237b'} {{(pid=88462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:25:05.742984 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [None req-bfaadcf5-15d9-43a0-a05e-fd0d6611cabf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57e94c46cf194672869564e7e878237b'} {{(pid=88462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:25:05.753248 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [None req-bfaadcf5-15d9-43a0-a05e-fd0d6611cabf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57e94c46cf194672869564e7e878237b'} {{(pid=88462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:25:05.771989 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [None req-bfaadcf5-15d9-43a0-a05e-fd0d6611cabf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57e94c46cf194672869564e7e878237b'} {{(pid=88462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:25:05.782530 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 631/1244] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 9 11:25:05 2022] DELETE /identity/v3/users/57e94c46cf194672869564e7e878237b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:25:05.987583 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc6a58-a1c1-4eb9-960a-5ec5c0b43b36 admin admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:05.989203 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-a4fc6a58-a1c1-4eb9-960a-5ec5c0b43b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:06.004543 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc6a58-a1c1-4eb9-960a-5ec5c0b43b36 admin admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:06.080795 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325597be-659a-453c-a3bb-7fd3697290d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:06.081484 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325597be-659a-453c-a3bb-7fd3697290d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:06.081766 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325597be-659a-453c-a3bb-7fd3697290d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:06.082047 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325597be-659a-453c-a3bb-7fd3697290d7 admin admin] PATH_INFO: `/v3/projects/f84fd4eecfbf4ca881d4bd2750aa1a49` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:06.083304 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325597be-659a-453c-a3bb-7fd3697290d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f84fd4eecfbf4ca881d4bd2750aa1a49)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:06.085515 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325597be-659a-453c-a3bb-7fd3697290d7 admin admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:06.135842 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [None req-325597be-659a-453c-a3bb-7fd3697290d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f84fd4eecfbf4ca881d4bd2750aa1a49', 'request_id': 'req-325597be-659a-453c-a3bb-7fd3697290d7'} {{(pid=88463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:25:06.143437 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [None req-325597be-659a-453c-a3bb-7fd3697290d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f84fd4eecfbf4ca881d4bd2750aa1a49', 'request_id': 'req-325597be-659a-453c-a3bb-7fd3697290d7'} {{(pid=88463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:25:06.150735 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [None req-325597be-659a-453c-a3bb-7fd3697290d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f84fd4eecfbf4ca881d4bd2750aa1a49', 'request_id': 'req-325597be-659a-453c-a3bb-7fd3697290d7'} {{(pid=88463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:25:06.162686 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [None req-325597be-659a-453c-a3bb-7fd3697290d7 admin admin] The token cache is being invalidate because project f84fd4eecfbf4ca881d4bd2750aa1a49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:25:06.162970 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [None req-325597be-659a-453c-a3bb-7fd3697290d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:25:06.163627 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [None req-325597be-659a-453c-a3bb-7fd3697290d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:25:06.166904 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 614/1245] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 9 11:25:05 2022] DELETE /identity/v3/projects/f84fd4eecfbf4ca881d4bd2750aa1a49 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:25:15.775740 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:16.159350 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:51.741138 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c091ad5-3597-4ea4-92f7-ac19498a548d None None] REQUEST_METHOD: `POST` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:51.741810 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c091ad5-3597-4ea4-92f7-ac19498a548d None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:51.741810 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c091ad5-3597-4ea4-92f7-ac19498a548d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:51.761702 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.auth.core [None req-0c091ad5-3597-4ea4-92f7-ac19498a548d None None] MFA Rules not processed for user `3e47b03ce2fd45c7b4d63e93f0170b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=88462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:51.762964 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-0c091ad5-3597-4ea4-92f7-ac19498a548d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:51.820538 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 632/1246] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 9 11:25:51 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:25:52.172962 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325597be-659a-453c-a3bb-7fd3697290d7 admin admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:52.174555 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-325597be-659a-453c-a3bb-7fd3697290d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:52.258802 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325597be-659a-453c-a3bb-7fd3697290d7 admin admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:52.262432 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521e851-e28c-4087-87b3-b3c3205e15b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:52.263344 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521e851-e28c-4087-87b3-b3c3205e15b7 service neutron] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:52.263830 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521e851-e28c-4087-87b3-b3c3205e15b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:52.264324 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521e851-e28c-4087-87b3-b3c3205e15b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:52.267296 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-f521e851-e28c-4087-87b3-b3c3205e15b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:52.280683 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521e851-e28c-4087-87b3-b3c3205e15b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:52.282274 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521e851-e28c-4087-87b3-b3c3205e15b7 service neutron] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:52.291200 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 615/1247] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:25:52 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:25:53.777105 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1429add-5bcf-4cb6-9831-b1ea5cb20191 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:53.777773 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1429add-5bcf-4cb6-9831-b1ea5cb20191 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:53.777930 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1429add-5bcf-4cb6-9831-b1ea5cb20191 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:53.780298 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 633/1248] 10.222.0.20 () {54 vars in 961 bytes} [Fri Sep 9 11:25:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:25:53.786706 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51b7e7-55ea-4bf7-8ec0-73c0977712cb None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:53.787335 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51b7e7-55ea-4bf7-8ec0-73c0977712cb None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:53.787335 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51b7e7-55ea-4bf7-8ec0-73c0977712cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:53.808919 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-ce51b7e7-55ea-4bf7-8ec0-73c0977712cb None None] MFA Rules not processed for user `ff72ca8bbc74499bb18ad4cb3ae2024c`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:53.810311 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-ce51b7e7-55ea-4bf7-8ec0-73c0977712cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:53.882954 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 616/1249] 10.222.0.20 () {58 vars in 1058 bytes} [Fri Sep 9 11:25:53 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:25:53.891080 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1429add-5bcf-4cb6-9831-b1ea5cb20191 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:53.905754 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1429add-5bcf-4cb6-9831-b1ea5cb20191 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:53.910690 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1011aa0-a957-4d15-8a17-54f59e3ebf24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff72ca8bbc74499bb18ad4cb3ae2024c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:53.911317 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1011aa0-a957-4d15-8a17-54f59e3ebf24 service placement] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:53.911582 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1011aa0-a957-4d15-8a17-54f59e3ebf24 service placement] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:53.911855 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1011aa0-a957-4d15-8a17-54f59e3ebf24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:53.913605 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-d1011aa0-a957-4d15-8a17-54f59e3ebf24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:53.925833 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1011aa0-a957-4d15-8a17-54f59e3ebf24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:53.927451 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1011aa0-a957-4d15-8a17-54f59e3ebf24 service placement] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:53.937929 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 634/1250] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:25:53 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:26:03.452498 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51b7e7-55ea-4bf7-8ec0-73c0977712cb None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:03.453976 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-ce51b7e7-55ea-4bf7-8ec0-73c0977712cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:03.526825 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51b7e7-55ea-4bf7-8ec0-73c0977712cb None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:03.532310 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280a9fc-7cd8-480f-8ba9-6fa656000c78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:03.532920 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280a9fc-7cd8-480f-8ba9-6fa656000c78 service nova] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:03.533193 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280a9fc-7cd8-480f-8ba9-6fa656000c78 service nova] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:03.533495 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280a9fc-7cd8-480f-8ba9-6fa656000c78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:03.535207 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-7280a9fc-7cd8-480f-8ba9-6fa656000c78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:03.546324 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280a9fc-7cd8-480f-8ba9-6fa656000c78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:03.547895 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280a9fc-7cd8-480f-8ba9-6fa656000c78 service nova] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:03.557905 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 617/1251] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:26:03 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:26:03.933662 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=31 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:08.080462 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5edcdb-3e61-437b-a42c-c7dde145db52 None None] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:08.081075 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5edcdb-3e61-437b-a42c-c7dde145db52 None None] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:08.081075 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5edcdb-3e61-437b-a42c-c7dde145db52 None None] PATH_INFO: `/` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:08.082667 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 635/1252] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 9 11:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:26:08.087572 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eaa083-6ed4-4078-aa0c-26595a005783 None None] REQUEST_METHOD: `POST` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:08.088130 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eaa083-6ed4-4078-aa0c-26595a005783 None None] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:08.088130 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eaa083-6ed4-4078-aa0c-26595a005783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:08.131308 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.auth.core [None req-29eaa083-6ed4-4078-aa0c-26595a005783 None None] MFA Rules not processed for user `417acfbae1244469961371115a42498e`. Rule list: `[]` (Enabled: `True`). {{(pid=88463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:08.132531 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-29eaa083-6ed4-4078-aa0c-26595a005783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:08.141568 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 618/1253] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 9 11:26:08 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:26:08.154895 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5edcdb-3e61-437b-a42c-c7dde145db52 None None] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:08.169402 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5edcdb-3e61-437b-a42c-c7dde145db52 None None] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:08.174363 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c048528-c61c-440a-b160-e4a5b7ce8f77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '417acfbae1244469961371115a42498e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:08.174998 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c048528-c61c-440a-b160-e4a5b7ce8f77 service nova] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:08.175279 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c048528-c61c-440a-b160-e4a5b7ce8f77 service nova] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:08.175546 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c048528-c61c-440a-b160-e4a5b7ce8f77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:08.184598 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c048528-c61c-440a-b160-e4a5b7ce8f77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:08.186241 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c048528-c61c-440a-b160-e4a5b7ce8f77 service nova] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:08.197591 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 636/1254] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:26:08 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:26:18.128324 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=96 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:18.192847 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=6 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:50.045596 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eaa083-6ed4-4078-aa0c-26595a005783 None None] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:50.047034 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-29eaa083-6ed4-4078-aa0c-26595a005783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:27:50.060605 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eaa083-6ed4-4078-aa0c-26595a005783 None None] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:50.065889 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e16eb1-c6f2-4f8b-ada9-2ace7d1f1c67 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff72ca8bbc74499bb18ad4cb3ae2024c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:50.066509 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e16eb1-c6f2-4f8b-ada9-2ace7d1f1c67 service placement] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:50.066804 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e16eb1-c6f2-4f8b-ada9-2ace7d1f1c67 service placement] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:50.067075 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e16eb1-c6f2-4f8b-ada9-2ace7d1f1c67 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:50.068779 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-d1e16eb1-c6f2-4f8b-ada9-2ace7d1f1c67 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:27:50.080801 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e16eb1-c6f2-4f8b-ada9-2ace7d1f1c67 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:50.082407 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e16eb1-c6f2-4f8b-ada9-2ace7d1f1c67 service placement] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:50.092672 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 619/1255] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:27:50 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:28:00.087978 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=6 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:28:35.457135 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c048528-c61c-440a-b160-e4a5b7ce8f77 service nova] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:28:35.469355 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c048528-c61c-440a-b160-e4a5b7ce8f77 service nova] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:28:35.473452 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb961448-c599-49da-a39c-5c7cfdfd49c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1693fd5ca6084609adcb148aa7d7a8d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:28:35.474083 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb961448-c599-49da-a39c-5c7cfdfd49c9 service neutron] REQUEST_METHOD: `GET` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:28:35.474402 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb961448-c599-49da-a39c-5c7cfdfd49c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:28:35.474674 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb961448-c599-49da-a39c-5c7cfdfd49c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:28:35.476535 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-eb961448-c599-49da-a39c-5c7cfdfd49c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:28:35.552499 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb961448-c599-49da-a39c-5c7cfdfd49c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:28:35.554060 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb961448-c599-49da-a39c-5c7cfdfd49c9 service neutron] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:28:35.566369 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 637/1256] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:28:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:28:42.116977 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e16eb1-c6f2-4f8b-ada9-2ace7d1f1c67 service placement] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:28:42.119438 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-d1e16eb1-c6f2-4f8b-ada9-2ace7d1f1c67 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:28:42.135162 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e16eb1-c6f2-4f8b-ada9-2ace7d1f1c67 service placement] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:28:42.141626 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6e7f6-37cd-48bd-9490-023acddd7eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:28:42.142276 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6e7f6-37cd-48bd-9490-023acddd7eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:28:42.142554 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6e7f6-37cd-48bd-9490-023acddd7eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:28:42.142825 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6e7f6-37cd-48bd-9490-023acddd7eb9 admin admin] PATH_INFO: `/v3/users/3e47b03ce2fd45c7b4d63e93f0170b2e` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:28:42.159355 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6e7f6-37cd-48bd-9490-023acddd7eb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e47b03ce2fd45c7b4d63e93f0170b2e)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:28:42.161241 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6e7f6-37cd-48bd-9490-023acddd7eb9 admin admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:28:42.220929 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [None req-09d6e7f6-37cd-48bd-9490-023acddd7eb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e47b03ce2fd45c7b4d63e93f0170b2e'} {{(pid=88463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:28:42.221602 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [None req-09d6e7f6-37cd-48bd-9490-023acddd7eb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e47b03ce2fd45c7b4d63e93f0170b2e'} {{(pid=88463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:28:42.230284 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [None req-09d6e7f6-37cd-48bd-9490-023acddd7eb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e47b03ce2fd45c7b4d63e93f0170b2e'} {{(pid=88463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:28:42.241253 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [None req-09d6e7f6-37cd-48bd-9490-023acddd7eb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e47b03ce2fd45c7b4d63e93f0170b2e'} {{(pid=88463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:28:42.265364 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [None req-09d6e7f6-37cd-48bd-9490-023acddd7eb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e47b03ce2fd45c7b4d63e93f0170b2e'} {{(pid=88463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:28:42.271642 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 620/1257] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 9 11:28:42 2022] DELETE /identity/v3/users/3e47b03ce2fd45c7b4d63e93f0170b2e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:28:42.462406 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb961448-c599-49da-a39c-5c7cfdfd49c9 service neutron] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:28:42.472542 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb961448-c599-49da-a39c-5c7cfdfd49c9 service neutron] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:28:42.542444 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c2dfb-6a59-4b1b-aa0f-77fb48de6ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:28:42.543089 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c2dfb-6a59-4b1b-aa0f-77fb48de6ff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:28:42.543368 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c2dfb-6a59-4b1b-aa0f-77fb48de6ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:28:42.543678 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c2dfb-6a59-4b1b-aa0f-77fb48de6ff2 admin admin] PATH_INFO: `/v3/projects/aa54cabbfbc44bbd98611ac527ad418d` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:28:42.556245 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c2dfb-6a59-4b1b-aa0f-77fb48de6ff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa54cabbfbc44bbd98611ac527ad418d)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:28:42.564119 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c2dfb-6a59-4b1b-aa0f-77fb48de6ff2 admin admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:28:42.628408 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [None req-fd7c2dfb-6a59-4b1b-aa0f-77fb48de6ff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa54cabbfbc44bbd98611ac527ad418d', 'request_id': 'req-fd7c2dfb-6a59-4b1b-aa0f-77fb48de6ff2'} {{(pid=88462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:28:42.639710 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [None req-fd7c2dfb-6a59-4b1b-aa0f-77fb48de6ff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa54cabbfbc44bbd98611ac527ad418d', 'request_id': 'req-fd7c2dfb-6a59-4b1b-aa0f-77fb48de6ff2'} {{(pid=88462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:28:42.647452 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [None req-fd7c2dfb-6a59-4b1b-aa0f-77fb48de6ff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa54cabbfbc44bbd98611ac527ad418d', 'request_id': 'req-fd7c2dfb-6a59-4b1b-aa0f-77fb48de6ff2'} {{(pid=88462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:28:42.663616 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [None req-fd7c2dfb-6a59-4b1b-aa0f-77fb48de6ff2 admin admin] The token cache is being invalidate because project aa54cabbfbc44bbd98611ac527ad418d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:28:42.663616 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [None req-fd7c2dfb-6a59-4b1b-aa0f-77fb48de6ff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:28:42.664023 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [None req-fd7c2dfb-6a59-4b1b-aa0f-77fb48de6ff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:28:42.665544 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 638/1258] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 9 11:28:42 2022] DELETE /identity/v3/projects/aa54cabbfbc44bbd98611ac527ad418d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:28:42.670490 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6e7f6-37cd-48bd-9490-023acddd7eb9 admin admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:28:42.672732 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-09d6e7f6-37cd-48bd-9490-023acddd7eb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:28:42.689750 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6e7f6-37cd-48bd-9490-023acddd7eb9 admin admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:28:42.752443 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff0a34-1641-4ecf-92e6-ea1bffefe488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:28:42.752986 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff0a34-1641-4ecf-92e6-ea1bffefe488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:28:42.753266 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff0a34-1641-4ecf-92e6-ea1bffefe488 admin admin] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:28:42.753564 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff0a34-1641-4ecf-92e6-ea1bffefe488 admin admin] PATH_INFO: `/v3/users/21c8af6b7f6442ee88f7982f1fce8220` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:28:42.768531 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff0a34-1641-4ecf-92e6-ea1bffefe488 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21c8af6b7f6442ee88f7982f1fce8220)` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:28:42.770507 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff0a34-1641-4ecf-92e6-ea1bffefe488 admin admin] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:28:42.822166 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [None req-4cff0a34-1641-4ecf-92e6-ea1bffefe488 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21c8af6b7f6442ee88f7982f1fce8220'} {{(pid=88463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:28:42.823095 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [None req-4cff0a34-1641-4ecf-92e6-ea1bffefe488 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21c8af6b7f6442ee88f7982f1fce8220'} {{(pid=88463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:28:42.827720 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:28:42.833690 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [None req-4cff0a34-1641-4ecf-92e6-ea1bffefe488 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21c8af6b7f6442ee88f7982f1fce8220'} {{(pid=88463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:28:42.842677 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [None req-4cff0a34-1641-4ecf-92e6-ea1bffefe488 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21c8af6b7f6442ee88f7982f1fce8220'} {{(pid=88463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:28:42.855326 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.notifications [None req-4cff0a34-1641-4ecf-92e6-ea1bffefe488 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21c8af6b7f6442ee88f7982f1fce8220'} {{(pid=88463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:28:42.862035 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 621/1259] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 9 11:28:42 2022] DELETE /identity/v3/users/21c8af6b7f6442ee88f7982f1fce8220 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:28:43.055202 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c2dfb-6a59-4b1b-aa0f-77fb48de6ff2 admin admin] Authenticating user token {{(pid=88462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:28:43.056682 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.fernet_utils [None req-fd7c2dfb-6a59-4b1b-aa0f-77fb48de6ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:28:43.082915 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c2dfb-6a59-4b1b-aa0f-77fb48de6ff2 admin admin] Validating token access rules against request {{(pid=88462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:28:43.096359 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:28:43.156878 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c30b3-d957-4cf7-8743-7af7a164d146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07397da3682f4089a3c3c8d08484a85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b0f23b110ec4b0cbf3d045893105ca2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:28:43.157564 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c30b3-d957-4cf7-8743-7af7a164d146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:28:43.157839 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c30b3-d957-4cf7-8743-7af7a164d146 admin admin] SCRIPT_NAME: `/identity` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:28:43.158108 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c30b3-d957-4cf7-8743-7af7a164d146 admin admin] PATH_INFO: `/v3/projects/9194207950334d7cab0717409db66c83` {{(pid=88462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:28:43.170853 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c30b3-d957-4cf7-8743-7af7a164d146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9194207950334d7cab0717409db66c83)` {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:28:43.173348 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c30b3-d957-4cf7-8743-7af7a164d146 admin admin] RBAC: Authorization granted {{(pid=88462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:28:43.233772 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [None req-389c30b3-d957-4cf7-8743-7af7a164d146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9194207950334d7cab0717409db66c83', 'request_id': 'req-389c30b3-d957-4cf7-8743-7af7a164d146'} {{(pid=88462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:28:43.242518 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [None req-389c30b3-d957-4cf7-8743-7af7a164d146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9194207950334d7cab0717409db66c83', 'request_id': 'req-389c30b3-d957-4cf7-8743-7af7a164d146'} {{(pid=88462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:28:43.248840 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [None req-389c30b3-d957-4cf7-8743-7af7a164d146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9194207950334d7cab0717409db66c83', 'request_id': 'req-389c30b3-d957-4cf7-8743-7af7a164d146'} {{(pid=88462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:28:43.262036 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [None req-389c30b3-d957-4cf7-8743-7af7a164d146 admin admin] The token cache is being invalidate because project 9194207950334d7cab0717409db66c83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:28:43.262398 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [None req-389c30b3-d957-4cf7-8743-7af7a164d146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:28:43.263077 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG keystone.notifications [None req-389c30b3-d957-4cf7-8743-7af7a164d146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:28:43.264598 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: [pid: 88462|app: 0|req: 639/1260] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 9 11:28:43 2022] DELETE /identity/v3/projects/9194207950334d7cab0717409db66c83 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:28:52.858516 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG dbcounter [-] [88463] Writing DB stats keystone:SELECT=12,keystone:DELETE=2 {{(pid=88463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:28:53.258664 dv-osbrick-856710-1-ceph devstack@keystone.service[88462]: DEBUG dbcounter [-] [88462] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:32:52.977348 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff0a34-1641-4ecf-92e6-ea1bffefe488 admin admin] Authenticating user token {{(pid=88463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:32:52.978780 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-4cff0a34-1641-4ecf-92e6-ea1bffefe488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:32:53.072905 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff0a34-1641-4ecf-92e6-ea1bffefe488 admin admin] Validating token access rules against request {{(pid=88463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:32:53.143199 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c780a9b-a1ff-4717-8468-40ceedb97999 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff72ca8bbc74499bb18ad4cb3ae2024c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9cec15abcd74e13ba458c64ad6fdf9b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:32:53.143822 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c780a9b-a1ff-4717-8468-40ceedb97999 service placement] REQUEST_METHOD: `GET` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:32:53.144106 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c780a9b-a1ff-4717-8468-40ceedb97999 service placement] SCRIPT_NAME: `/identity` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:32:53.144394 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c780a9b-a1ff-4717-8468-40ceedb97999 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:32:53.146195 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.fernet_utils [None req-2c780a9b-a1ff-4717-8468-40ceedb97999 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:32:53.161816 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c780a9b-a1ff-4717-8468-40ceedb97999 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:32:53.163428 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c780a9b-a1ff-4717-8468-40ceedb97999 service placement] RBAC: Authorization granted {{(pid=88463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:32:53.174222 dv-osbrick-856710-1-ceph devstack@keystone.service[88463]: [pid: 88463|app: 0|req: 622/1261] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 9 11:32:52 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)